-- Logs begin at Sat 2021-11-27 20:01:15 UTC, end at Sat 2021-11-27 22:28:22 UTC. -- Nov 27 20:36:48.139988 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Nov 27 20:36:51.417544 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=128914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:36:51.418671 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=128914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:36:51.796136 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_db.sqlalchemy.engines [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:36:52.098413 ncdv-master-1 cinder-volume[128914]: INFO cinder.rpc [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 27 20:36:52.102464 ncdv-master-1 cinder-volume[128914]: INFO cinder.rpc [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 27 20:36:52.113380 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_db.sqlalchemy.engines [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:36:52.176461 ncdv-master-1 cinder-volume[128914]: INFO cinder.volume.manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Determined volume DB was empty at startup. Nov 27 20:36:52.177089 ncdv-master-1 cinder-volume[128914]: DEBUG cinder.volume.manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=128914) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Nov 27 20:36:52.185797 ncdv-master-1 cinder-volume[128914]: INFO cinder.volume.manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 27 20:36:52.186603 ncdv-master-1 cinder-volume[128914]: WARNING stevedore.named [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:36:52.187047 ncdv-master-1 cinder-volume[128914]: WARNING castellan.key_manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:36:52.188229 ncdv-master-1 cinder-volume[128914]: WARNING cinder.keymgr.conf_key_mgr [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:36:52.204756 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_db.sqlalchemy.engines [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:36:52.211844 ncdv-master-1 cinder-volume[128914]: INFO cinder.rpc [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 27 20:36:52.217358 ncdv-master-1 cinder-volume[128914]: INFO cinder.rpc [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Nov 27 20:36:52.218214 ncdv-master-1 cinder-volume[128914]: WARNING stevedore.named [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:36:52.218752 ncdv-master-1 cinder-volume[128914]: WARNING castellan.key_manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:36:52.221333 ncdv-master-1 cinder-volume[128914]: INFO cinder.volume.manager [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Image-volume cache enabled for host ncdv-master-1@ceph. Nov 27 20:36:52.227827 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_db.sqlalchemy.engines [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:36:52.250107 ncdv-master-1 cinder-volume[128914]: INFO oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Starting 1 workers Nov 27 20:36:52.255547 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Started child 129088 {{(pid=128914) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 27 20:36:52.256754 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Full set of CONF: {{(pid=128914) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 27 20:36:52.257549 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ******************************************************************************** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:36:52.258092 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] Configuration options gathered from: {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:36:52.258681 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:36:52.259561 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:36:52.260138 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ================================================================================ {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:36:52.264112 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] allow_availability_zone_fallback = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.264792 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] allow_compression_on_image_upload = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.265624 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] allowed_direct_url_schemes = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.266486 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] api_rate_limit = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.267540 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] auth_strategy = keystone {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.268342 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] az_cache_duration = 3600 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.269022 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_availability_zone = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.269879 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_host = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.270546 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.271161 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_stats_polling_interval = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.276945 ncdv-master-1 cinder-volume[129088]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Nov 27 20:36:52.278608 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backup_api_class = cinder.backup.api.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.279335 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.279870 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backup_name_template = backup-%s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.280677 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backup_use_same_host = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.281448 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backup_use_temp_snapshot = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.282063 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] chap_password = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.282654 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] chap_username = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.283295 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.283945 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_internal_tenant_project_id = 59c371d9310548a3ac5cf1cb274d0e34 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.284582 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_internal_tenant_user_id = 198c9372013440ec942a0192a73a231d {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.285155 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cloned_volume_same_az = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.285722 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cluster = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.286332 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] compression_format = gzip {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.287604 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] compute_api_class = cinder.compute.nova.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.288549 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] config_dir = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.289067 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.289662 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] config_source = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.290233 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.290860 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] control_exchange = openstack {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.291501 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] debug = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.292089 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] default_availability_zone = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.293188 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] default_group_type = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.294074 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.294704 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] default_volume_type = ceph {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.295283 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_client_cert = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.295844 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_client_cert_key = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.296388 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_data_namespace = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.296935 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_ssl_cert_path = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.297492 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_ssl_cert_verify = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.298077 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] driver_use_ssl = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.298952 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] enable_force_upload = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.299498 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] enable_new_services = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.300077 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] enable_unsupported_driver = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.300753 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] enabled_backends = ['ceph'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.301329 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] enforce_multipath_for_image_xfer = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.301873 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] filter_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.302423 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_api_insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.303010 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_api_servers = ['http://10.222.0.21/image'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.303626 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_api_ssl_compression = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.304192 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_ca_certificates_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.304823 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_catalog_info = image:glance:publicURL {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.305429 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.306121 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.306700 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.307169 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_num_retries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.307638 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] glance_request_timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.308078 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] goodness_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.309436 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] graceful_shutdown_timeout = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.309809 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] group_api_class = cinder.group.api.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.310304 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] host = ncdv-master-1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.310897 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iet_conf = /etc/iet/ietd.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.311499 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_compress_on_upload = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.312079 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_conversion_address_space_limit = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.312626 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_conversion_cpu_limit = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.313337 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.313907 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_upload_use_cinder_backend = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.314463 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_upload_use_internal_tenant = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.315020 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_volume_cache_enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.315598 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_volume_cache_max_count = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.316184 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Starting volume driver RBDDriver (1.2.0) Nov 27 20:36:52.316292 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] image_volume_cache_max_size_gb = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.316895 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] init_host_max_objects_retrieval = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.317489 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] instance_format = [instance: %(uuid)s] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.317966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.318265 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.318849 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iscsi_iotype = fileio {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.319716 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iscsi_secondary_ip_addresses = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.320296 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iscsi_target_flags = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.320853 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iscsi_write_cache = on {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.321431 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iser_helper = tgtadm {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.322247 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iser_ip_address = 10.222.0.21 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.322878 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iser_port = 3260 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.323472 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.324114 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_config_append = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.324728 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.325278 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_dir = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.325831 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.326965 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_options = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.327580 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_rotate_interval = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.328171 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_rotate_interval_type = days {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.328794 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] log_rotation_type = none {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.329471 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.329979 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.330751 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.331347 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.331839 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.332430 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] max_age = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.332978 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] max_logfile_count = 30 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.333535 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] max_logfile_size_mb = 200 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.334152 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] max_over_subscription_ratio = 20.0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.334751 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] message_reap_interval = 86400 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.335205 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] message_ttl = 2592000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.335680 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] migration_create_volume_timeout_secs = 300 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.336111 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] monkey_patch = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.336536 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] monkey_patch_modules = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.337133 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] my_ip = 10.222.0.21 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.337805 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] no_snapshot_gb_quota = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.338898 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] num_iser_scan_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.339893 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] num_shell_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.340457 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] num_volume_device_scan_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.341195 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] nvmet_ns_id = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.341567 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] nvmet_port_id = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.341974 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_max_limit = 1000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.342361 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_ext_list = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.342807 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.343183 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_listen = 0.0.0.0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.343575 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_listen_port = 8776 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.343922 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_use_ssl = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.344278 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] osapi_volume_workers = 2 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.344639 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] per_volume_size_limit = -1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.344981 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] periodic_fuzzy_delay = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.345333 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] periodic_interval = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.345683 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] public_endpoint = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.346025 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] publish_errors = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.346390 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_backup_gigabytes = 1000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.347234 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_backups = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.347760 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_consistencygroups = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.348298 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.349125 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_gigabytes = 1000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.349639 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_groups = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.350389 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_snapshots = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.350973 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] quota_volumes = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.351877 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] rate_limit_burst = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.352494 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] rate_limit_except_level = CRITICAL {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.353010 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] rate_limit_interval = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.354226 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] reinit_driver_count = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.355800 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] replication_device = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.356162 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] report_discard_supported = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.356518 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] report_interval = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.356964 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] reservation_clean_interval = 86400 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.357259 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] reservation_expire = 86400 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.357608 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] reserved_percentage = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.358005 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.358363 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.358767 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] rpc_response_timeout = 120 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.359110 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] run_external_periodic_tasks = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.361968 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.362384 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] scst_target_driver = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.362738 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] scst_target_iqn_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.363036 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_down_time = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.363475 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] snapshot_name_template = snapshot-%s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.363832 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] snapshot_same_host = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.365029 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] split_loggers = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.368303 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] state_path = /opt/stack/data/cinder {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.368797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.368989 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] storage_availability_zone = nova {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.369485 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] storage_protocol = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.369976 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] syslog_log_facility = LOG_USER {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.372404 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] target_helper = lioadm {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.373029 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] target_ip_address = 10.222.0.21 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.373509 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] target_port = 3260 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.373986 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.374838 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] target_protocol = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.375324 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] trace_flags = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.375819 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] transfer_api_class = cinder.transfer.api.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.376362 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] transport_url = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.376838 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] until_refresh = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.377309 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_chap_auth = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.377774 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_default_quota_class = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.378227 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_eventlog = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.378705 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_journal = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.379162 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_json = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.379653 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_multipath_for_image_xfer = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.380236 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_stderr = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.380809 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] use_syslog = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.381300 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] verify_glance_signatures = enabled {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.382467 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_api_class = cinder.volume.api.API {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.382929 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_backend_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.383461 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_clear = zero {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.383816 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_clear_ionice = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.384989 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_clear_size = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.384989 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.384989 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_copy_bps_limit = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.385322 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_dd_blocksize = 1M {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.385683 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.386640 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_name_template = volume-%s {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.386640 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_service_inithost_offload = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.386808 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volume_usage_audit_period = month {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.387227 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.387628 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] watch_log_file = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.387976 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] zoning_mode = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:36:52.389092 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.389092 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.389248 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.enforce_new_defaults = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.389627 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.enforce_scope = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.390377 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.policy_default_rule = default {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.390377 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.390970 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.policy_file = policy.yaml {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.391405 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.391766 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.392795 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.393159 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.393624 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.395019 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_concurrency.disable_process_locking = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.395755 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.396366 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.admin_password = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.396902 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.397420 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.admin_token = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.397792 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.admin_user = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.398419 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_admin_prefix = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.398793 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.399173 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_port = 35357 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.399589 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_protocol = https {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.400494 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_section = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.400494 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_type = password {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.400923 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_uri = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.401288 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.auth_version = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.401643 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.cache = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.402891 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.403436 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.403799 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.delay_auth_decision = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.404185 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.404558 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.http_connect_timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.404914 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.405259 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.identity_uri = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.405629 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.include_service_catalog = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.405977 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.406363 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.interface = public {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.406707 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.407054 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.407935 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.407935 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.408223 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.408746 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.409092 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.409458 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.412080 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.412080 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.412659 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.region_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.413405 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.413772 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.service_token_roles_required = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.414141 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.service_type = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.414499 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.token_cache_time = 300 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.414949 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] keystone_authtoken.www_authenticate_uri = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.415449 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.backend = dogpile.cache.null {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.415832 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.backend_argument = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.416196 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.config_prefix = cache.oslo {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.416628 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.debug_cache_backend = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.416981 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.417347 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.expiration_time = 600 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.418196 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.418309 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_dead_retry = 300 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.418737 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.418956 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.420218 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_pool_maxsize = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.420619 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.421018 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.421440 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.memcache_socket_timeout = 1.0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.421822 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.proxies = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.422167 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.tls_allowed_ciphers = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.422536 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.tls_cafile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.422895 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.tls_certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.423396 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.tls_enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.423739 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cache.tls_keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.424146 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] coordination.backend_url = etcd3+http://10.222.0.21:2379 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.424792 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.backend = sqlalchemy {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.425262 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.connection = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.425775 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.connection_debug = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.426269 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.connection_parameters = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.426764 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.connection_recycle_time = 3600 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.427305 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.connection_trace = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.427797 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.db_inc_retry_interval = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.428292 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.db_max_retries = 20 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.428790 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.db_max_retry_interval = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.429297 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.db_retry_interval = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.429827 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.max_overflow = 50 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.430331 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.max_pool_size = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.430827 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.max_retries = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.431345 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.mysql_enable_ndb = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.431866 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.432355 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.pool_timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.432888 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.retry_interval = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.434048 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.slave_connection = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.434552 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.sqlite_synchronous = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.435038 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] database.use_db_reconnect = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.435622 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.436135 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.436638 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.437147 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.437651 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.438216 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.connection_string = messaging:// {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.438512 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.438891 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.es_doc_type = notification {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.439240 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.es_scroll_size = 10000 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.440026 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.es_scroll_time = 2m {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.440026 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.filter_error_trace = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.440610 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.hmac_keys = SECRET_KEY {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.441417 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.sentinel_service_name = mymaster {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445249 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.socket_timeout = 0.1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445249 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] profiler.trace_sqlalchemy = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445249 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.capabilities = [21] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445249 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.group = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445249 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.helper_command = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445610 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.445794 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.447503 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] privsep_osbrick.user = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.448068 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.448616 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.group = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.449240 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.helper_command = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.449809 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.450496 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.451059 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] cinder_sys_admin.user = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.452213 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.auth_section = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.452584 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.auth_type = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.452964 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.cafile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.453273 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.453676 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.collect_timing = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.454029 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.454380 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.454730 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.send_service_user_token = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.455132 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.split_loggers = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.455465 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] service_user.timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.456100 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.backend_availability_zone = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.456686 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.457208 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.457720 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.chap_password = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.458235 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.chap_username = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.459212 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.459212 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.459405 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.459651 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_client_cert = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.459993 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_client_cert_key = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.460340 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_data_namespace = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.460679 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.461023 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.461366 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.driver_use_ssl = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.461711 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.enable_deferred_deletion = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.462055 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.enable_unsupported_driver = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.462423 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.462781 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.extra_capabilities = {} {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.463117 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.filter_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.465895 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.goodness_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.466286 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.466651 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.467010 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.467402 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.467755 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.468117 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.468489 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iscsi_iotype = fileio {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.468850 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.469225 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iscsi_target_flags = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.469609 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iscsi_write_cache = on {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.469962 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iser_helper = tgtadm {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.470503 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iser_ip_address = 10.222.0.21 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.471028 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iser_port = 3260 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.471221 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.471625 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.472320 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.472781 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.num_shell_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.473145 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.473495 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.473853 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.nvmet_port_id = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.474214 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rados_connect_timeout = -1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.474567 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rados_connection_interval = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.474929 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rados_connection_retries = 3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.475106 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.driver [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Driver hasn't implemented _init_vendor_properties() Nov 27 20:36:52.475332 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_ceph_conf = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.475701 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_cluster_name = ceph {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.475942 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.driver [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:496c2857-3e27-4aff-b700-6e398ccedfa6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129088) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Nov 27 20:36:52.476061 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.476384 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.476767 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.477134 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_pool = rbd {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.477473 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_secret_uuid = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.477822 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.478169 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.rbd_user = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.478514 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.replication_connect_timeout = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.478859 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.replication_device = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.479204 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.report_discard_supported = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.481168 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.481704 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.reserved_percentage = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.482231 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.scst_target_driver = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.482742 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.scst_target_iqn_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.483112 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.storage_protocol = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.484690 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.484690 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.target_helper = tgtadm {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.485128 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.target_ip_address = 10.222.0.21 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.485752 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.target_port = 3260 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.485852 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.486201 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.target_protocol = iscsi {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.486545 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.trace_flags = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.486916 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.unique_fqdn_network = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.488235 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.use_chap_auth = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.488235 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.488235 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_backend_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.488466 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_clear = zero {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.488765 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_clear_ionice = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.489275 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_clear_size = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.489633 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.490619 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.490619 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.490798 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.491151 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.491561 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_reports.file_event_handler = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.491942 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.492306 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_reports.log_dir = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.492695 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.backend_availability_zone = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.493039 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.backend_host = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.493389 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.backend_native_threads_pool_size = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.493731 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.backup_use_temp_snapshot = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.494097 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.chap_password = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.494437 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.chap_username = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.494781 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.chiscsi_conf = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.495138 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.deferred_deletion_delay = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.495510 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.deferred_deletion_purge_interval = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.496424 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_client_cert = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.496703 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:36:52.496814 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_client_cert_key = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.497107 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_data_namespace = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.497501 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_ssl_cert_path = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.497805 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_ssl_cert_verify = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.498148 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.driver_use_ssl = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.498491 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.enable_deferred_deletion = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.498843 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.enable_unsupported_driver = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.499184 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.499553 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.extra_capabilities = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.500149 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.filter_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.500495 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.goodness_function = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.500837 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iet_conf = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.501176 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.image_upload_use_cinder_backend = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.501520 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.image_upload_use_internal_tenant = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.501903 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.image_volume_cache_enabled = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.502234 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.image_volume_cache_max_count = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.502589 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.image_volume_cache_max_size_gb = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.502939 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iscsi_iotype = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.503320 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.503668 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iscsi_target_flags = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.504007 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iscsi_write_cache = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.504346 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iser_helper = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.504685 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iser_ip_address = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.505055 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iser_port = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.505382 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.iser_target_prefix = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.506587 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.max_over_subscription_ratio = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.506986 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.num_iser_scan_tries = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.507397 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.num_shell_tries = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.507766 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.num_volume_device_scan_tries = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.508130 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.nvmet_ns_id = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.508594 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.nvmet_port_id = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.508980 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rados_connect_timeout = -1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.509337 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rados_connection_interval = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.509688 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rados_connection_retries = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.510077 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.510422 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_cluster_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.510798 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.511161 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.511576 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_max_clone_depth = 5 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.511930 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_pool = volumes {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.512288 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_secret_uuid = 3c2f8537-22d4-4a83-aaae-7c3c3923127c {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.512687 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_store_chunk_size = 4 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.513036 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.rbd_user = cinder {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.513382 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.replication_connect_timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.513722 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.replication_device = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.514060 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.report_discard_supported = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.514396 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.report_dynamic_total_capacity = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.514736 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.reserved_percentage = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.515072 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.scst_target_driver = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.515448 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.scst_target_iqn_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.516217 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.storage_protocol = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.516800 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.suppress_requests_ssl_warnings = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.517283 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.target_helper = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.517629 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.target_ip_address = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.517974 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.target_port = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.518314 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.target_prefix = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.518658 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.target_protocol = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.519026 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.trace_flags = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.519429 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.unique_fqdn_network = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.520179 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.use_chap_auth = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.520691 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.use_multipath_for_image_xfer = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.521704 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_backend_name = ceph {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.521704 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_clear = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.521704 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_clear_ionice = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.522085 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_clear_size = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.522383 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.522718 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_copy_bps_limit = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.523053 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_dd_blocksize = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.523457 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.523797 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ceph.volumes_dir = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.524949 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.524949 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.524949 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.525319 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.525652 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.526044 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.527632 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.527632 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.527632 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.528005 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.528625 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.529150 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.529667 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.530021 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.530358 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.532682 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.533250 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.533642 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.534818 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.534818 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.534818 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.535471 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.ssl = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.535841 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.536343 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.536745 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.537111 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_rabbit.ssl_version = {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.537445 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_notifications.driver = [] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.537815 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_notifications.retry = -1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.538204 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.538565 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] oslo_messaging_notifications.transport_url = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.538900 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.539186 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] key_manager.fixed_key = **** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.539789 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.540806 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.barbican_api_version = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.540806 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.barbican_endpoint = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.540968 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.barbican_endpoint_type = public {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.541247 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.barbican_region_name = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.541584 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.cafile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.541919 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.543040 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.collect_timing = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.543507 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.543848 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.544198 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.number_of_retries = 60 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.544543 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.retry_delay = 1 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.544885 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.send_service_user_token = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.545231 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.split_loggers = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.545563 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.545912 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.verify_ssl = True {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.546228 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.db.sqlalchemy.api [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Building query based on filter {{(pid=129088) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Nov 27 20:36:52.547408 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican.verify_ssl_path = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.548785 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.auth_section = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.549296 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.auth_type = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.549785 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.cafile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.550506 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.551387 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.collect_timing = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.552056 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.552541 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.553029 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.split_loggers = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.553655 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] barbican_service_user.timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.554604 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.approle_role_id = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.555482 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.approle_secret_id = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.556103 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.cafile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.556679 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.certfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.556950 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.collect_timing = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.557343 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.insecure = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.557691 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.keyfile = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.558066 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.kv_mountpoint = secret {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.559033 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.kv_version = 2 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.559381 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.namespace = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.559731 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.root_token_id = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.561042 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.split_loggers = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.561042 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.ssl_ca_crt_file = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.561042 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.timeout = None {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.561309 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.use_ssl = False {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.562198 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:36:52.563351 ncdv-master-1 cinder-volume[128914]: DEBUG oslo_service.service [None req-df08416d-b4f0-419f-91f5-4b1438fe970f None None] ******************************************************************************** {{(pid=128914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:36:52.571443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129088) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Nov 27 20:36:52.581467 ncdv-master-1 cinder-volume[129088]: INFO cinder.keymgr.migration [None req-546ccabf-a5c3-4d2f-a4ce-477b21bc501f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 27 20:36:52.585845 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.612842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.645949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:36:52.680146 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Driver initialization completed successfully. Nov 27 20:36:52.688329 ncdv-master-1 cinder-volume[129088]: INFO cinder.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Initiating service 3 cleanup Nov 27 20:36:52.693723 ncdv-master-1 cinder-volume[129088]: INFO cinder.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Service 3 cleanup completed. Nov 27 20:36:52.694046 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.service [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Creating RPC server for service cinder-volume {{(pid=129088) start /opt/stack/cinder/cinder/service.py:231}} Nov 27 20:36:52.700305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.service [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129088) start /opt/stack/cinder/cinder/service.py:237}} Nov 27 20:36:52.781003 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Nov 27 20:36:52.782493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.804296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:36:52.857958 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2c63d1af-a8b5-48cd-9e44-40085e86ab83 None None] Driver post RPC initialization completed successfully. Nov 27 20:37:57.861750 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:37:57.862926 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:37:57.884996 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:37:57.905938 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:38:57.861111 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:38:57.861850 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:38:57.894351 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:38:57.924061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:39:57.862958 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:39:57.864081 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:39:57.887304 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:39:57.909886 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:40:57.865166 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:40:57.865883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:40:57.887277 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:40:57.908553 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:41:57.864081 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:41:57.864788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:41:57.885181 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:41:57.906948 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:42:57.862485 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:42:57.863206 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:42:57.887619 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:42:57.909299 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:43:57.865394 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:43:57.866324 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:43:57.888275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:43:57.913287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:44:57.868952 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:44:57.869684 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:44:57.892563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:44:57.915869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:45:57.872744 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:45:57.876591 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:45:57.956844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:45:57.999995 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:46:57.872209 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:46:57.873322 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:46:57.953202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:46:58.051161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:47:57.874564 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:47:57.876663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:47:57.968077 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:47:58.083549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:48:44.485463 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:48:44.505356 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:48:44.518141 ncdv-master-1 cinder-volume[129088]: INFO cinder.rpc [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Nov 27 20:48:44.527868 ncdv-master-1 cinder-volume[129088]: INFO cinder.rpc [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Nov 27 20:48:44.531210 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:48:44.532574 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:48:44.572175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (ea42d2f8-92dc-48b1-aae9-32b0ab250fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:48:44.575996 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666b7218-ef5b-4b6d-bbf2-512682effa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:44.585300 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:48:44.670429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666b7218-ef5b-4b6d-bbf2-512682effa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-91341790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=531124a5-0591-4505-b7a9-fd42aca352f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9eca53282994b4094a056750bb24ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:48:44Z,use_quota=True,user_id='2d326a07ce104727bec8ae98dabea64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:44.674337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26712c2-6c39-4d97-ac25-202eda9d0782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:44.676832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26712c2-6c39-4d97-ac25-202eda9d0782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:44.694338 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af79cb9-fde8-46d3-9837-de13bb331893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:44.701272 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af79cb9-fde8-46d3-9837-de13bb331893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531124a5-0591-4505-b7a9-fd42aca352f7', 'volume_name': 'volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:44.707735 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed1801b-b40b-4583-b2e5-ac8261326417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:44.715352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed1801b-b40b-4583-b2e5-ac8261326417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:44.722510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c07d95-1570-4111-884c-a9da41d61c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:44.725032 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume 531124a5-0591-4505-b7a9-fd42aca352f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'volume_size': 1} Nov 27 20:48:44.726202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] creating volume 'volume-531124a5-0591-4505-b7a9-fd42aca352f7' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:48:44.730052 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:48:45.127188 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:48:45.128251 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:48:45.130034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c07d95-1570-4111-884c-a9da41d61c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:45.133041 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbda9bf-8a80-484d-84b1-e402a8394426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:45.146278 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-531124a5-0591-4505-b7a9-fd42aca352f7 (531124a5-0591-4505-b7a9-fd42aca352f7): created successfully Nov 27 20:48:45.149654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbda9bf-8a80-484d-84b1-e402a8394426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:45.154107 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (ea42d2f8-92dc-48b1-aae9-32b0ab250fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:48:45.168590 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-973a6c13-5b86-4188-8a17-b1ff3e86ddf6 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created volume successfully. Nov 27 20:48:49.917773 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-1b64507f-704e-47d8-bc31-15c1c144f092 req-c3c01051-c111-4cc5-8613-8f3586cd3056 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:48:50.890050 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-1b64507f-704e-47d8-bc31-15c1c144f092 req-c3c01051-c111-4cc5-8613-8f3586cd3056 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.971s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:48:50.891530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-1b64507f-704e-47d8-bc31-15c1c144f092 req-c3c01051-c111-4cc5-8613-8f3586cd3056 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '531124a5-0591-4505-b7a9-fd42aca352f7', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:48:50.949644 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-1b64507f-704e-47d8-bc31-15c1c144f092 req-c3c01051-c111-4cc5-8613-8f3586cd3056 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Connection info returned from driver {'name': 'volumes/volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '531124a5-0591-4505-b7a9-fd42aca352f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '888f93e5-d0d0-4c4f-b7db-1ad2b3c8a983'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:48:51.044867 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-1b64507f-704e-47d8-bc31-15c1c144f092 req-c3c01051-c111-4cc5-8613-8f3586cd3056 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] attachment_update completed successfully. Nov 27 20:48:53.034987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:48:53.039050 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:48:53.039724 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:48:53.053913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Flow 'volume_create_manager' (79d2ffca-a288-4ffb-a890-9c03e2da41ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:48:53.057831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce5a23b-54cc-4846-88ed-9c688c00d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.065578 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:48:53.079594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce5a23b-54cc-4846-88ed-9c688c00d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1427401813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fd33332-c012-4d3f-89d3-348f26863f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d0433d36494c339de083939adfa30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:48:53Z,use_quota=True,user_id='4230d9b8ef6540bfbc4f034885d418e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.083124 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4f6f0a-8e8c-4081-a19b-eb714e2bcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.085597 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4f6f0a-8e8c-4081-a19b-eb714e2bcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.088431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad61f3f2-7643-4899-a48d-129566a9d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.091223 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad61f3f2-7643-4899-a48d-129566a9d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd33332-c012-4d3f-89d3-348f26863f24', 'volume_name': 'volume-5fd33332-c012-4d3f-89d3-348f26863f24', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.094765 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e10b1-c59f-4b61-94d4-1f15020a4fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.097715 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e10b1-c59f-4b61-94d4-1f15020a4fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.100344 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb79e1b-e5d6-46c4-824b-d8dd585da3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.101364 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Volume 5fd33332-c012-4d3f-89d3-348f26863f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd33332-c012-4d3f-89d3-348f26863f24', 'volume_size': 1} Nov 27 20:48:53.101985 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] creating volume 'volume-5fd33332-c012-4d3f-89d3-348f26863f24' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:48:53.103440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:48:53.200410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:48:53.201187 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:48:53.204697 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb79e1b-e5d6-46c4-824b-d8dd585da3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd33332-c012-4d3f-89d3-348f26863f24', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.209438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebf82df-8ed9-4bc6-a2b0-0136bcbb5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:48:53.221002 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Volume volume-5fd33332-c012-4d3f-89d3-348f26863f24 (5fd33332-c012-4d3f-89d3-348f26863f24): created successfully Nov 27 20:48:53.223532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebf82df-8ed9-4bc6-a2b0-0136bcbb5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:48:53.226861 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Flow 'volume_create_manager' (79d2ffca-a288-4ffb-a890-9c03e2da41ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:48:53.238269 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5eb18894-ecf3-4625-9a66-0762e02cd1b5 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Created volume successfully. Nov 27 20:48:54.844728 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 req-b9fffa16-c51f-4713-90ca-119952b42c13 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:48:55.567417 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 req-b9fffa16-c51f-4713-90ca-119952b42c13 tempest-AttachSCSIVolumeTestJSON-1788431328 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.723s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:48:55.568647 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 req-b9fffa16-c51f-4713-90ca-119952b42c13 tempest-AttachSCSIVolumeTestJSON-1788431328 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5fd33332-c012-4d3f-89d3-348f26863f24', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '5fd33332-c012-4d3f-89d3-348f26863f24', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:48:55.603916 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 req-b9fffa16-c51f-4713-90ca-119952b42c13 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Connection info returned from driver {'name': 'volumes/volume-5fd33332-c012-4d3f-89d3-348f26863f24', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5fd33332-c012-4d3f-89d3-348f26863f24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a215a3b6-13ef-46b4-8ad6-5ce1044a3318'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:48:55.684919 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 req-b9fffa16-c51f-4713-90ca-119952b42c13 tempest-AttachSCSIVolumeTestJSON-1788431328 None] attachment_update completed successfully. Nov 27 20:48:57.773345 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-b8c78973-0c4b-4b62-be87-7b1299b262f1 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:48:58.562796 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-b8c78973-0c4b-4b62-be87-7b1299b262f1 tempest-LiveAutoBlockMigrationV225Test-70634603 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.789s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:48:58.565094 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-b8c78973-0c4b-4b62-be87-7b1299b262f1 tempest-LiveAutoBlockMigrationV225Test-70634603 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '531124a5-0591-4505-b7a9-fd42aca352f7', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:48:58.596380 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-b8c78973-0c4b-4b62-be87-7b1299b262f1 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Connection info returned from driver {'name': 'volumes/volume-531124a5-0591-4505-b7a9-fd42aca352f7', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '531124a5-0591-4505-b7a9-fd42aca352f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df747d37-d074-4653-acc8-5719fc80722b'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:48:58.665202 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-b8c78973-0c4b-4b62-be87-7b1299b262f1 tempest-LiveAutoBlockMigrationV225Test-70634603 None] attachment_update completed successfully. Nov 27 20:49:02.005006 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-8556e084-d402-4d41-a2be-8c7d838ef083 req-a5027ddb-f767-4a76-9fdb-3ef3d503bab7 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Terminate volume connection completed successfully. Nov 27 20:49:02.005664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-8556e084-d402-4d41-a2be-8c7d838ef083 req-a5027ddb-f767-4a76-9fdb-3ef3d503bab7 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Deleting attachment a215a3b6-13ef-46b4-8ad6-5ce1044a3318. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:49:06.010838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:49:06.015318 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:49:06.016118 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:49:06.031287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Flow 'volume_create_manager' (3f59163b-9825-4be4-80a3-ac19e88e8d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:06.035173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52911fe3-bf02-4516-9da6-190cc57917f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.042239 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:49:06.055932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52911fe3-bf02-4516-9da6-190cc57917f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-321129890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc5e1853-9753-4aec-9663-f67f2c4249be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149906b8a2744176929b4d314a0de57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:49:06Z,use_quota=True,user_id='1d46c71936aa4118aa36a9e95b95c4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.058780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a0db43-ed4c-48ce-8f30-ac957cf22ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.060959 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a0db43-ed4c-48ce-8f30-ac957cf22ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.063360 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00204e45-e11b-41f7-90ef-e48897994bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.065844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00204e45-e11b-41f7-90ef-e48897994bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5e1853-9753-4aec-9663-f67f2c4249be', 'volume_name': 'volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.068523 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff1e60-1757-4ff8-af1e-144b4e31651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.070639 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff1e60-1757-4ff8-af1e-144b4e31651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.072870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11c8d70-34c3-4c42-ac8d-fb7035613145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.073654 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Volume fc5e1853-9753-4aec-9663-f67f2c4249be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'volume_size': 1} Nov 27 20:49:06.074061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] creating volume 'volume-fc5e1853-9753-4aec-9663-f67f2c4249be' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:49:06.075374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:06.154609 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:49:06.155286 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:49:06.157839 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11c8d70-34c3-4c42-ac8d-fb7035613145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.160599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09ea0d-013b-4976-a81e-00aad04cfdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:06.170752 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Volume volume-fc5e1853-9753-4aec-9663-f67f2c4249be (fc5e1853-9753-4aec-9663-f67f2c4249be): created successfully Nov 27 20:49:06.173779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b09ea0d-013b-4976-a81e-00aad04cfdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:06.177412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Flow 'volume_create_manager' (3f59163b-9825-4be4-80a3-ac19e88e8d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:06.187585 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d9550da4-0156-4209-9feb-71bcd569bbbc tempest-LiveMigrationTest-292468335 None] Created volume successfully. Nov 27 20:49:07.568794 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b14533d9-f939-4624-ad41-41738f650b8a req-99347340-38bf-42ee-b9f9-dc16ab476902 tempest-LiveMigrationTest-292468335 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:08.405574 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b14533d9-f939-4624-ad41-41738f650b8a req-99347340-38bf-42ee-b9f9-dc16ab476902 tempest-LiveMigrationTest-292468335 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.836s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:08.406359 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-b14533d9-f939-4624-ad41-41738f650b8a req-99347340-38bf-42ee-b9f9-dc16ab476902 tempest-LiveMigrationTest-292468335 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'fc5e1853-9753-4aec-9663-f67f2c4249be', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:49:08.434368 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b14533d9-f939-4624-ad41-41738f650b8a req-99347340-38bf-42ee-b9f9-dc16ab476902 tempest-LiveMigrationTest-292468335 None] Connection info returned from driver {'name': 'volumes/volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fc5e1853-9753-4aec-9663-f67f2c4249be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2dc68d96-f18c-4694-bb36-7f5825fcdb9f'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:49:08.501501 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b14533d9-f939-4624-ad41-41738f650b8a req-99347340-38bf-42ee-b9f9-dc16ab476902 tempest-LiveMigrationTest-292468335 None] attachment_update completed successfully. Nov 27 20:49:09.789516 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-245058dc-7e6d-4f0f-90b2-0ed4898c7823 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Terminate volume connection completed successfully. Nov 27 20:49:09.790132 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba req-245058dc-7e6d-4f0f-90b2-0ed4898c7823 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Deleting attachment 888f93e5-d0d0-4c4f-b7db-1ad2b3c8a983. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:49:10.894129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Lock "b'cinder-5fd33332-c012-4d3f-89d3-348f26863f24-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:49:10.962346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:11.053268 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:49:11.059798 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Volume volume-5fd33332-c012-4d3f-89d3-348f26863f24 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:49:11.093330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] deleting rbd volume volume-5fd33332-c012-4d3f-89d3-348f26863f24 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:49:11.366714 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 27 20:49:11.368279 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 27 20:49:11.393973 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Created reservations ['1a900289-77f5-48ed-9fb8-a993715a47ff', '3713ded4-dfe0-4531-be39-a8dbe99290a9', 'eec194e5-3a71-41f3-93d8-f108e388f5fc', 'f1f95bb3-f8cf-4cc2-b334-1baa06da7af1'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:49:11.501576 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:11.574774 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:11.642311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:49:11.656523 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Deleted volume successfully. Nov 27 20:49:11.676201 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b1798d8b-a9c9-400b-b653-ad5a843f0f85 tempest-AttachSCSIVolumeTestJSON-1788431328 None] Lock "b'cinder-5fd33332-c012-4d3f-89d3-348f26863f24-delete_volume'" released by "delete_volume" :: held 0.782s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:49:15.739138 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c req-ecc9d77f-9987-48d1-ab9e-29a936b4920b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Terminate volume connection completed successfully. Nov 27 20:49:15.741276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c req-ecc9d77f-9987-48d1-ab9e-29a936b4920b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deleting attachment df747d37-d074-4653-acc8-5719fc80722b. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:49:15.815917 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-6a1fb3ce-cf3f-4918-8cfc-ba9679e3f963 tempest-LiveMigrationTest-1032860350 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:16.779475 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-6a1fb3ce-cf3f-4918-8cfc-ba9679e3f963 tempest-LiveMigrationTest-1032860350 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.963s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:16.780463 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-6a1fb3ce-cf3f-4918-8cfc-ba9679e3f963 tempest-LiveMigrationTest-1032860350 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'fc5e1853-9753-4aec-9663-f67f2c4249be', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:49:16.826975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:49:16.832343 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:49:16.833159 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:49:16.847099 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (94c3b732-0051-47e4-aee5-fd7c07b431c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:16.850614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b810431-f7fd-4c43-8c72-bc1f70b48aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:16.855065 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-6a1fb3ce-cf3f-4918-8cfc-ba9679e3f963 tempest-LiveMigrationTest-1032860350 None] Connection info returned from driver {'name': 'volumes/volume-fc5e1853-9753-4aec-9663-f67f2c4249be', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fc5e1853-9753-4aec-9663-f67f2c4249be', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '198aa5b7-5cd8-4f6b-b820-2b1166526920'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:49:16.862732 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:49:16.888429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b810431-f7fd-4c43-8c72-bc1f70b48aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-396764988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96fb951e-cc34-4858-9c6f-c24a0ea53a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9eca53282994b4094a056750bb24ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:49:17Z,use_quota=True,user_id='2d326a07ce104727bec8ae98dabea64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:16.894000 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29cd46e-a159-4208-aa4c-ec668ef681db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:16.896492 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29cd46e-a159-4208-aa4c-ec668ef681db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:16.900039 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c3a8ce-5ef9-432b-b92c-a525a9952341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:17.100687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c3a8ce-5ef9-432b-b92c-a525a9952341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'volume_name': 'volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:17.108180 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa80d2-ec1d-4521-96c9-35010ec52867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:17.110856 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa80d2-ec1d-4521-96c9-35010ec52867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:17.113173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93aae09-ea75-44cb-a429-db535e519c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:17.114075 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume 96fb951e-cc34-4858-9c6f-c24a0ea53a71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 20:49:17.114755 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Cloning 96fb951e-cc34-4858-9c6f-c24a0ea53a71 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 20:49:17.130907 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-6a1fb3ce-cf3f-4918-8cfc-ba9679e3f963 tempest-LiveMigrationTest-1032860350 None] attachment_update completed successfully. Nov 27 20:49:17.169251 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.052s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:49:17.210810 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Preparing cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Nov 27 20:49:17.213702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 20:49:27.556881 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-103ab878-0e05-44a3-a3c4-68a029e4b748 tempest-LiveMigrationTest-1032860350 None] Terminate volume connection completed successfully. Nov 27 20:49:27.558646 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b21d8f1c-3c68-4604-b511-aa07b3545186 req-103ab878-0e05-44a3-a3c4-68a029e4b748 tempest-LiveMigrationTest-1032860350 None] Deleting attachment 2dc68d96-f18c-4694-bb36-7f5825fcdb9f. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:49:35.461560 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph, size 616.00 MB, duration 18.23 sec {{(pid=129088) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Nov 27 20:49:35.462291 ncdv-master-1 cinder-volume[129088]: INFO cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Image download 616.00 MB at 33.79 MB/s Nov 27 20:49:35.549521 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:35.717569 ncdv-master-1 sudo[140246]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph Nov 27 20:49:35.719185 ncdv-master-1 sudo[140246]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:36.842868 ncdv-master-1 sudo[140246]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:36.845881 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph" returned: 0 in 1.296s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:36.851598 ncdv-master-1 cinder-volume[129088]: WARNING py.warnings [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 27 20:49:36.851598 ncdv-master-1 cinder-volume[129088]: debtcollector.deprecate( Nov 27 20:49:36.851598 ncdv-master-1 cinder-volume[129088]: Nov 27 20:49:36.852711 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Temporary image dad06d36-e5fe-4577-8da6-2101ffe62bc8 is fetched for user 2d326a07ce104727bec8ae98dabea64d. {{(pid=129088) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Nov 27 20:49:36.949886 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:37.181733 ncdv-master-1 sudo[140282]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph Nov 27 20:49:37.182556 ncdv-master-1 sudo[140282]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:38.012301 ncdv-master-1 sudo[140282]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:38.014363 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph" returned: 0 in 1.064s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:38.015860 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] creating volume 'volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:49:38.017379 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:38.168452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:49:38.169243 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:49:38.205038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Attempting download of dad06d36-e5fe-4577-8da6-2101ffe62bc8 ((None, None)) to volume 96fb951e-cc34-4858-9c6f-c24a0ea53a71. {{(pid=129088) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Nov 27 20:49:38.272989 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_dad06d36-e5fe-4577-8da6-2101ffe62bc8_aemhwt17 {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:38.503039 ncdv-master-1 sudo[140337]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_dad06d36-e5fe-4577-8da6-2101ffe62bc8_aemhwt17 Nov 27 20:49:38.503961 ncdv-master-1 sudo[140337]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:38.550769 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-c3dcf038-1456-4a04-b4b4-9765a271d284 req-dfdddb4d-0ad0-498f-9007-034f347a1405 tempest-LiveMigrationTest-292468335 None] Terminate volume connection completed successfully. Nov 27 20:49:38.551291 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c3dcf038-1456-4a04-b4b4-9765a271d284 req-dfdddb4d-0ad0-498f-9007-034f347a1405 tempest-LiveMigrationTest-292468335 None] Deleting attachment 198aa5b7-5cd8-4f6b-b820-2b1166526920. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:49:39.477729 ncdv-master-1 sudo[140337]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:39.479964 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_dad06d36-e5fe-4577-8da6-2101ffe62bc8_aemhwt17" returned: 0 in 1.207s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:39.480474 ncdv-master-1 cinder-volume[129088]: WARNING py.warnings [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 27 20:49:39.480474 ncdv-master-1 cinder-volume[129088]: debtcollector.deprecate( Nov 27 20:49:39.480474 ncdv-master-1 cinder-volume[129088]: Nov 27 20:49:39.481204 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:39.633073 ncdv-master-1 sudo[140355]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph Nov 27 20:49:39.635161 ncdv-master-1 sudo[140355]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:40.304368 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:49:40.309870 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:49:40.310591 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:49:40.327105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Flow 'volume_create_manager' (442d134b-acd9-44d2-b22d-50f5bcdbbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:40.331818 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190d92f2-7ef4-41e7-956a-33ea57fc91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:40.343937 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:49:40.364822 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190d92f2-7ef4-41e7-956a-33ea57fc91ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-186035647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d11b7295-70ad-482a-85d7-2803b1944190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149906b8a2744176929b4d314a0de57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:49:40Z,use_quota=True,user_id='1d46c71936aa4118aa36a9e95b95c4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:40.368014 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e643b762-3a50-4905-8222-76a1f317970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:40.387224 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e643b762-3a50-4905-8222-76a1f317970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:40.390824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a234e1a-0d8e-40c2-be81-d764aefda072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:40.589599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a234e1a-0d8e-40c2-be81-d764aefda072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd11b7295-70ad-482a-85d7-2803b1944190', 'volume_name': 'volume-d11b7295-70ad-482a-85d7-2803b1944190', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:40.594712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ebb2e7-81dc-4565-a040-736c32fb156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:40.610276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ebb2e7-81dc-4565-a040-736c32fb156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:40.613515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b01786-3c26-40dc-84c5-cbc6765563ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:40.614648 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Volume d11b7295-70ad-482a-85d7-2803b1944190: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d11b7295-70ad-482a-85d7-2803b1944190', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 20:49:40.615551 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Cloning d11b7295-70ad-482a-85d7-2803b1944190 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 20:49:40.803011 ncdv-master-1 sudo[140355]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:40.805748 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph" returned: 0 in 1.325s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:40.806697 ncdv-master-1 cinder-volume[129088]: WARNING py.warnings [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 27 20:49:40.806697 ncdv-master-1 cinder-volume[129088]: debtcollector.deprecate( Nov 27 20:49:40.806697 ncdv-master-1 cinder-volume[129088]: Nov 27 20:49:40.807682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] dad06d36-e5fe-4577-8da6-2101ffe62bc8 was vhdx, converting to raw {{(pid=129088) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Nov 27 20:49:40.808870 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmppwcoy36s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:40.849243 ncdv-master-1 sudo[140420]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmppwcoy36s Nov 27 20:49:40.850938 ncdv-master-1 sudo[140420]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:42.864467 ncdv-master-1 sudo[140420]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:42.871491 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmppwcoy36s" returned: 0 in 2.062s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:42.872645 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:42.990561 ncdv-master-1 sudo[140501]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph Nov 27 20:49:42.991463 ncdv-master-1 sudo[140501]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 27 20:49:43.716947 ncdv-master-1 sudo[140501]: pam_unix(sudo:session): session closed for user root Nov 27 20:49:43.720974 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph" returned: 0 in 0.848s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:43.721884 ncdv-master-1 cinder-volume[129088]: WARNING py.warnings [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 27 20:49:43.721884 ncdv-master-1 cinder-volume[129088]: debtcollector.deprecate( Nov 27 20:49:43.721884 ncdv-master-1 cinder-volume[129088]: Nov 27 20:49:43.722704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dad06d36-e5fe-4577-8da6-2101ffe62bc8_cuoei9jdncdv-master-1@ceph, size 700.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/conversion/tmppwcoy36s {{(pid=129088) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Nov 27 20:49:43.723169 ncdv-master-1 cinder-volume[129088]: INFO cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Converted 700.00 MB image at 339.22 MB/s Nov 27 20:49:43.724931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:43.833215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:49:43.833739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:49:43.843795 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] deleting rbd volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:49:44.075065 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmppwcoy36s volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:48.722668 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmppwcoy36s volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.647s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:48.947516 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:49.148617 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:49:49.148836 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:49:49.149393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Downloaded image dad06d36-e5fe-4577-8da6-2101ffe62bc8 ((None, None)) to volume 96fb951e-cc34-4858-9c6f-c24a0ea53a71 successfully. {{(pid=129088) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Nov 27 20:49:49.381407 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Temporary image dad06d36-e5fe-4577-8da6-2101ffe62bc8 for user 2d326a07ce104727bec8ae98dabea64d is deleted. {{(pid=129088) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Nov 27 20:49:49.597289 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created reservations ['1f2acf1b-676c-467c-b593-e8f87a102970', 'f80abd69-e65b-4cca-baf7-78e0127300e4', '1f7960c6-b83d-44ad-86c3-486665dc68aa', '5424bf49-d5a8-4269-bf22-464c2d6fd96b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:49:49.608261 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Creating image volume entry: {'service_uuid': None, 'scheduled_at': datetime.datetime(2021, 11, 27, 20, 49, 17, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'cluster_name': None, 'host': 'ncdv-master-1@ceph#ceph', 'provider_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'updated_at': datetime.datetime(2021, 11, 27, 20, 49, 17, tzinfo=datetime.timezone.utc), 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'bootable': False, 'group_id': None, 'consistencygroup_id': None, 'terminated_at': None, 'deleted': False, 'created_at': datetime.datetime(2021, 11, 27, 20, 49, 17, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'replication_status': None, 'provider_geometry': None, 'size': 1, 'replication_driver_data': None, 'metadata': {}, 'display_name': 'image-dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_type_id': '425f3ffd-b3de-492e-b90b-364a8317bba9', 'volume_metadata': [], 'replication_extended_status': None, 'display_description': None, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'shared_targets': True, 'volume_admin_metadata': [], 'multiattach': False, 'ec2_id': None, 'provider_location': None, 'provider_auth': None, 'availability_zone': 'nova', 'previous_status': None, 'launched_at': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '96fb951e-cc34-4858-9c6f-c24a0ea53a71'}. {{(pid=129088) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Nov 27 20:49:49.783835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume reschedule parameters: False retry: None {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:49:49.790603 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:49:49.794594 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:49:49.829162 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (98af71a2-de9e-4c14-a8f4-2aa9f24d1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:49.835831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d33f493-9d18-46fb-afdd-6b7b708db7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:49.843428 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:49:49.865864 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d33f493-9d18-46fb-afdd-6b7b708db7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='image-dad06d36-e5fe-4577-8da6-2101ffe62bc8',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=433fd822-ffe5-4ab5-8263-5d965af3008e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c371d9310548a3ac5cf1cb274d0e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=96fb951e-cc34-4858-9c6f-c24a0ea53a71,status='creating',terminated_at=None,updated_at=2021-11-27T20:49:17Z,use_quota=True,user_id='2d326a07ce104727bec8ae98dabea64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:49.869425 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fa336f-7f41-4cd5-9331-ccdc05d70361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:49.872179 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fa336f-7f41-4cd5-9331-ccdc05d70361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:49.875570 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb38be7-29ec-47e6-ba74-66561c2b2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:49.927034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb38be7-29ec-47e6-ba74-66561c2b2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'volume_name': 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e', 'volume_size': 1, 'source_volid': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'source_volstatus': 'downloading'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:49.930456 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335ee809-55b9-4ca9-a6e8-4dc25399b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:49.933156 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335ee809-55b9-4ca9-a6e8-4dc25399b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:49.937841 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a14a8e-3017-4b32-b419-4c16d78c98b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:49.941280 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume 433fd822-ffe5-4ab5-8263-5d965af3008e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e', 'volume_size': 1, 'source_volid': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'source_volstatus': 'downloading'} Nov 27 20:49:49.954890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:50.125315 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] creating snapshot='volume-433fd822-ffe5-4ab5-8263-5d965af3008e.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 20:49:50.970244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] cloning 'volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71@volume-433fd822-ffe5-4ab5-8263-5d965af3008e.clone_snap' to 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 20:49:51.122653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:49:51.124084 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:49:51.124727 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:49:51.160329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 20:49:51.162951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a14a8e-3017-4b32-b419-4c16d78c98b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e', 'volume_size': 1, 'source_volid': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'source_volstatus': 'downloading'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:51.168034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b404f6fc-dc1d-4d76-81cf-b7a08aa3867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:51.194267 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-433fd822-ffe5-4ab5-8263-5d965af3008e (433fd822-ffe5-4ab5-8263-5d965af3008e): created successfully Nov 27 20:49:51.197142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b404f6fc-dc1d-4d76-81cf-b7a08aa3867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:51.200829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (98af71a2-de9e-4c14-a8f4-2aa9f24d1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:51.213324 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created volume successfully. Nov 27 20:49:51.262941 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Creating new image-volume cache entry for image dad06d36-e5fe-4577-8da6-2101ffe62bc8 on ncdv-master-1@ceph#ceph {{(pid=129088) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Nov 27 20:49:51.273386 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] New image-volume cache entry created: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 49, 51, 266936)}. {{(pid=129088) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Nov 27 20:49:51.294411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 34.127s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:49:51.296661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Marking volume 96fb951e-cc34-4858-9c6f-c24a0ea53a71 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 20:49:51.309633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 96fb951e-cc34-4858-9c6f-c24a0ea53a71. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 20:49:51.310517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Creating volume glance metadata for volume 96fb951e-cc34-4858-9c6f-c24a0ea53a71 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 20:49:51.381987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93aae09-ea75-44cb-a429-db535e519c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:51.384362 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ff61ae-efbd-4ac3-8cb6-d63ee25d94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:51.393315 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 (96fb951e-cc34-4858-9c6f-c24a0ea53a71): created successfully Nov 27 20:49:51.397034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ff61ae-efbd-4ac3-8cb6-d63ee25d94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:51.400312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Flow 'volume_create_manager' (94c3b732-0051-47e4-aee5-fd7c07b431c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:51.411499 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f5acf989-53a6-42c8-aba2-8bb13e9b8af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created volume successfully. Nov 27 20:49:52.004435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 11.388s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:49:52.044517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 49, 52, 25938)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:49:52.045024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:49:52.048822 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 20:49:52.060345 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.056s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:49:52.065309 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 20:49:52.084440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 49, 52, 76730)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:49:52.087909 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:49:52.088498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 20:49:52.130616 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:52.331856 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] creating snapshot='volume-d11b7295-70ad-482a-85d7-2803b1944190.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 20:49:53.011226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-d11b7295-70ad-482a-85d7-2803b1944190.clone_snap' to 'volume-d11b7295-70ad-482a-85d7-2803b1944190' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 20:49:53.215545 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:49:53.220733 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:49:53.223301 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:49:53.257107 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 20:49:53.258915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Marking volume d11b7295-70ad-482a-85d7-2803b1944190 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 20:49:53.275335 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to d11b7295-70ad-482a-85d7-2803b1944190. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 20:49:53.276024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Creating volume glance metadata for volume d11b7295-70ad-482a-85d7-2803b1944190 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 20:49:53.378381 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b01786-3c26-40dc-84c5-cbc6765563ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11b7295-70ad-482a-85d7-2803b1944190', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:53.380713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79339d85-b14a-43f8-b662-16bb4072564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:49:53.398814 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Volume volume-d11b7295-70ad-482a-85d7-2803b1944190 (d11b7295-70ad-482a-85d7-2803b1944190): created successfully Nov 27 20:49:53.401902 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79339d85-b14a-43f8-b662-16bb4072564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:49:53.405436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Flow 'volume_create_manager' (442d134b-acd9-44d2-b22d-50f5bcdbbe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:49:53.419302 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fb401de1-5624-40ae-99b4-11766f59819b tempest-LiveMigrationTest-292468335 None] Created volume successfully. Nov 27 20:49:56.267112 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac req-fff4003a-56f4-40a3-a92e-95e5fbb3c27c tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:57.483959 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac req-fff4003a-56f4-40a3-a92e-95e5fbb3c27c tempest-LiveAutoBlockMigrationV225Test-1157895455 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.216s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:57.485568 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac req-fff4003a-56f4-40a3-a92e-95e5fbb3c27c tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:49:57.530604 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac req-fff4003a-56f4-40a3-a92e-95e5fbb3c27c tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Connection info returned from driver {'name': 'volumes/volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'efcb4143-d7a5-4c20-a24b-7c3816d1b60a'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:49:57.637732 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac req-fff4003a-56f4-40a3-a92e-95e5fbb3c27c tempest-LiveAutoBlockMigrationV225Test-1157895455 None] attachment_update completed successfully. Nov 27 20:49:57.874534 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:49:57.875901 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:57.950344 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:49:57.991202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:49:58.502361 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a req-4e682cfd-2c5d-457e-9ae8-a47322871188 tempest-LiveMigrationTest-292468335 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:49:59.804982 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a req-4e682cfd-2c5d-457e-9ae8-a47322871188 tempest-LiveMigrationTest-292468335 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.301s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:49:59.807139 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a req-4e682cfd-2c5d-457e-9ae8-a47322871188 tempest-LiveMigrationTest-292468335 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d11b7295-70ad-482a-85d7-2803b1944190', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'd11b7295-70ad-482a-85d7-2803b1944190', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:49:59.849642 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a req-4e682cfd-2c5d-457e-9ae8-a47322871188 tempest-LiveMigrationTest-292468335 None] Connection info returned from driver {'name': 'volumes/volume-d11b7295-70ad-482a-85d7-2803b1944190', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd11b7295-70ad-482a-85d7-2803b1944190', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '11bc26dd-0bd4-4f36-91cd-06f4f70ea226'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:49:59.959917 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a req-4e682cfd-2c5d-457e-9ae8-a47322871188 tempest-LiveMigrationTest-292468335 None] attachment_update completed successfully. Nov 27 20:50:21.037289 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-242292e7-2ffc-4354-9723-b7efc3f2a7e6 tempest-LiveMigrationTest-1032860350 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:50:21.837306 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-242292e7-2ffc-4354-9723-b7efc3f2a7e6 tempest-LiveMigrationTest-1032860350 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.799s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:50:21.838284 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-242292e7-2ffc-4354-9723-b7efc3f2a7e6 tempest-LiveMigrationTest-1032860350 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d11b7295-70ad-482a-85d7-2803b1944190', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'd11b7295-70ad-482a-85d7-2803b1944190', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:50:21.920502 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-434aacb1-d835-4b1a-90ed-8861a003e646 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:50:21.946414 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-242292e7-2ffc-4354-9723-b7efc3f2a7e6 tempest-LiveMigrationTest-1032860350 None] Connection info returned from driver {'name': 'volumes/volume-d11b7295-70ad-482a-85d7-2803b1944190', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd11b7295-70ad-482a-85d7-2803b1944190', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dbf6d62a-bbc4-497e-aed3-214ad6000dc2'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:50:22.026815 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-242292e7-2ffc-4354-9723-b7efc3f2a7e6 tempest-LiveMigrationTest-1032860350 None] attachment_update completed successfully. Nov 27 20:50:22.661428 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-434aacb1-d835-4b1a-90ed-8861a003e646 tempest-LiveAutoBlockMigrationV225Test-70634603 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.741s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:50:22.662116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-434aacb1-d835-4b1a-90ed-8861a003e646 tempest-LiveAutoBlockMigrationV225Test-70634603 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:50:22.699206 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-434aacb1-d835-4b1a-90ed-8861a003e646 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Connection info returned from driver {'name': 'volumes/volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '96fb951e-cc34-4858-9c6f-c24a0ea53a71', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'be5d9327-1229-44e0-9063-43c3a0f9a29f'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:50:22.817609 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-434aacb1-d835-4b1a-90ed-8861a003e646 tempest-LiveAutoBlockMigrationV225Test-70634603 None] attachment_update completed successfully. Nov 27 20:50:32.835732 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-a2ebd492-d000-4dbe-91b3-5d2fa74fec98 tempest-LiveMigrationTest-1032860350 None] Terminate volume connection completed successfully. Nov 27 20:50:32.836861 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e0312fcd-ebf6-4755-a507-337bf0db6233 req-a2ebd492-d000-4dbe-91b3-5d2fa74fec98 tempest-LiveMigrationTest-1032860350 None] Deleting attachment 11bc26dd-0bd4-4f36-91cd-06f4f70ea226. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:50:57.879762 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:50:57.880734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:50:57.914785 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:50:57.949928 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:51:08.874730 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-19d6e4c1-1f35-412a-9887-ce98b364e7a3 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Terminate volume connection completed successfully. Nov 27 20:51:08.875242 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf req-19d6e4c1-1f35-412a-9887-ce98b364e7a3 tempest-LiveAutoBlockMigrationV225Test-70634603 None] Deleting attachment efcb4143-d7a5-4c20-a24b-7c3816d1b60a. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:51:13.458308 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-55f8c018-903c-4191-9b06-2f414c6ae634 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Terminate volume connection completed successfully. Nov 27 20:51:13.458975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-55f8c018-903c-4191-9b06-2f414c6ae634 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deleting attachment be5d9327-1229-44e0-9063-43c3a0f9a29f. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:51:13.619586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-96fb951e-cc34-4858-9c6f-c24a0ea53a71-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:51:13.680001 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:13.772428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:51:13.773258 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] volume has clone snapshot(s) {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Nov 27 20:51:13.775453 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:51:13.921296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created reservations ['76bdc18c-2ff3-41c9-a038-9deefb9a33fa', '5d34fb22-d4e2-46a9-b7e8-75973f87831e', '88a1bc5e-ae95-42ab-a980-bece94a08917', 'e3a065e1-86f7-4e8a-bfd6-3debb62c888c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:51:13.976522 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:14.010342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:14.039005 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:51:14.043093 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deleted volume successfully. Nov 27 20:51:14.064103 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-43294f20-3c66-480c-beb0-4e42ff20afa6 req-4b7f9de8-e945-4e9a-bd4d-b1365742fd9b tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-96fb951e-cc34-4858-9c6f-c24a0ea53a71-delete_volume'" released by "delete_volume" :: held 0.445s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:51:14.516643 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-531124a5-0591-4505-b7a9-fd42aca352f7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:51:14.557508 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:14.599662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:51:14.600116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Volume volume-531124a5-0591-4505-b7a9-fd42aca352f7 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:51:14.606831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] deleting rbd volume volume-531124a5-0591-4505-b7a9-fd42aca352f7 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:51:14.853283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Created reservations ['25c31976-fbe1-401b-9d54-ee27640b9a89', '10ca6960-1fcb-4444-a2a5-5d7df8812687', 'f4f7c799-a789-4c05-8a22-cfbc78da2b1c', '0f5e75a4-658d-463d-a35c-6a9b576f0918'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:51:14.898947 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:14.927413 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:14.958728 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:51:14.963702 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Deleted volume successfully. Nov 27 20:51:14.976477 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-39c2efb2-eac0-4ba9-affa-f7b9ad4ad2c5 tempest-LiveAutoBlockMigrationV225Test-1157895455 None] Lock "b'cinder-531124a5-0591-4505-b7a9-fd42aca352f7-delete_volume'" released by "delete_volume" :: held 0.460s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:51:27.477395 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-a8bca309-2bda-4e92-9bfa-7c1b04252c20 tempest-LiveMigrationTest-292468335 None] Terminate volume connection completed successfully. Nov 27 20:51:27.478087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-a8bca309-2bda-4e92-9bfa-7c1b04252c20 tempest-LiveMigrationTest-292468335 None] Deleting attachment dbf6d62a-bbc4-497e-aed3-214ad6000dc2. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:51:27.694152 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-d11b7295-70ad-482a-85d7-2803b1944190-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:51:27.739972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:27.875849 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:51:27.893713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] deleting rbd volume volume-d11b7295-70ad-482a-85d7-2803b1944190 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:51:28.320601 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 20:51:28.372392 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] deleting parent snapshot volume-d11b7295-70ad-482a-85d7-2803b1944190.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 20:51:29.193059 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-fc5e1853-9753-4aec-9663-f67f2c4249be-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:51:29.268388 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:29.346951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:51:29.347941 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Volume volume-fc5e1853-9753-4aec-9663-f67f2c4249be is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:51:29.357381 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] deleting rbd volume volume-fc5e1853-9753-4aec-9663-f67f2c4249be {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:51:29.373746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] Created reservations ['b4187a23-ecb4-4b56-aa9c-8a64e7a38e28', '60c6e260-61c4-400b-a734-6059e214e718', '1514f359-8b6a-496a-9731-f866ae829518', '9fa076e1-ffbc-44ac-a796-c2a64046ff37'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:51:29.477205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:29.539676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:29.583430 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:51:29.584727 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] Deleted volume successfully. Nov 27 20:51:29.602532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-42d30c28-3b32-4330-8e1f-a7cd9a35285c req-797e185b-b698-408f-ab74-b5acc0d60605 tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-d11b7295-70ad-482a-85d7-2803b1944190-delete_volume'" released by "delete_volume" :: held 1.908s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:51:29.848964 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Created reservations ['400b5ea4-eee2-418c-9471-bc708162d86d', '14925b87-ae30-4216-b021-708d9e2ceb92', 'd0902c35-9e01-436e-9450-fdc70978463f', 'bd87bde6-0cff-48f7-b0eb-fb06e7b12aab'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:51:29.924199 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:29.996580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:30.068054 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:51:30.078403 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Deleted volume successfully. Nov 27 20:51:30.111675 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-04a8d613-e67b-4134-a10c-3b411f0456df tempest-LiveMigrationTest-292468335 None] Lock "b'cinder-fc5e1853-9753-4aec-9663-f67f2c4249be-delete_volume'" released by "delete_volume" :: held 0.918s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:51:57.877817 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:51:57.879370 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:57.950370 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:51:58.012136 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:52:41.399874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:52:41.420114 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:52:41.420648 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:52:41.454824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (1da3a40a-25b7-49ac-92fc-3f1221f50c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:52:41.473064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04df762c-20bc-418b-abf1-1a05b16a421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.483777 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:52:41.500318 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04df762c-20bc-418b-abf1-1a05b16a421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-947711044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cad55e6f-4b88-4111-9cfb-0a54a768ecde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79226c480677428e924a69a8e4c01ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:52:41Z,use_quota=True,user_id='6f940822793e422c8436036be6a116a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.504514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bf5c89-1eab-48ac-8676-0fbb597ebd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.506761 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bf5c89-1eab-48ac-8676-0fbb597ebd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.509202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948020e-09fb-4dd4-827b-951f05fbefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.511720 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a948020e-09fb-4dd4-827b-951f05fbefe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'volume_name': 'volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.514669 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12b8b2-da8b-4bfd-b11d-80f8ad7379f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.517038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12b8b2-da8b-4bfd-b11d-80f8ad7379f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.519451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3578026-3c81-463d-8a5e-bac51bb6b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.520433 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Volume cad55e6f-4b88-4111-9cfb-0a54a768ecde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'volume_size': 1} Nov 27 20:52:41.521091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] creating volume 'volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:52:41.522561 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:52:41.642842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:52:41.643223 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:52:41.645244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3578026-3c81-463d-8a5e-bac51bb6b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.647434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615fb054-60b9-44a6-8eff-3b375a87f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:52:41.671002 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde (cad55e6f-4b88-4111-9cfb-0a54a768ecde): created successfully Nov 27 20:52:41.673703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615fb054-60b9-44a6-8eff-3b375a87f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:52:41.676937 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (1da3a40a-25b7-49ac-92fc-3f1221f50c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:52:41.693061 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b8ac7fb0-d866-453c-a2cd-60c79ac409c2 tempest-AttachVolumeNegativeTest-36724854 None] Created volume successfully. Nov 27 20:52:43.236938 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-89e965f2-b424-4e58-b544-b4449c101ffc req-3fc9e8b3-979e-42e0-9b96-bc45218a40ae tempest-AttachVolumeNegativeTest-36724854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:52:44.224407 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-89e965f2-b424-4e58-b544-b4449c101ffc req-3fc9e8b3-979e-42e0-9b96-bc45218a40ae tempest-AttachVolumeNegativeTest-36724854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.988s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:52:44.225383 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-89e965f2-b424-4e58-b544-b4449c101ffc req-3fc9e8b3-979e-42e0-9b96-bc45218a40ae tempest-AttachVolumeNegativeTest-36724854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:52:44.274936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-89e965f2-b424-4e58-b544-b4449c101ffc req-3fc9e8b3-979e-42e0-9b96-bc45218a40ae tempest-AttachVolumeNegativeTest-36724854 None] Connection info returned from driver {'name': 'volumes/volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cad55e6f-4b88-4111-9cfb-0a54a768ecde', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e7bc86ff-03da-482a-ba38-8470b10b32ea'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:52:44.405611 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-89e965f2-b424-4e58-b544-b4449c101ffc req-3fc9e8b3-979e-42e0-9b96-bc45218a40ae tempest-AttachVolumeNegativeTest-36724854 None] attachment_update completed successfully. Nov 27 20:52:57.878000 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:52:57.880444 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:52:57.949400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:52:58.014274 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:53:01.179406 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:53:01.184054 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:53:01.185190 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:53:01.207201 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Flow 'volume_create_manager' (3f4bdcad-205c-4394-8463-c566516d5a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:01.210846 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75013a32-3a7d-4401-b16d-de9c556a07b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.218911 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:53:01.239531 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75013a32-3a7d-4401-b16d-de9c556a07b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-20165816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bb8e6d39-28b6-481a-996e-22a668b9411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57434a24104e95bcff0d4cabbd1419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:53:01Z,use_quota=True,user_id='9de6e0419e7843089302fa399e9e56aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.243149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43defb98-b9bb-437d-81bd-f9a4d6528e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.246216 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43defb98-b9bb-437d-81bd-f9a4d6528e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.249717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57160c23-56fc-4329-bd27-16dde7f2a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.262721 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57160c23-56fc-4329-bd27-16dde7f2a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8e6d39-28b6-481a-996e-22a668b9411c', 'volume_name': 'volume-bb8e6d39-28b6-481a-996e-22a668b9411c', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.266484 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762df2d6-17fc-47b5-9e7c-67e7444e4008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.269234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (762df2d6-17fc-47b5-9e7c-67e7444e4008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.271644 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5d2aab-6fa4-4a8b-9eac-c3300b29d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.272507 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Volume bb8e6d39-28b6-481a-996e-22a668b9411c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8e6d39-28b6-481a-996e-22a668b9411c', 'volume_size': 1} Nov 27 20:53:01.272980 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] creating volume 'volume-bb8e6d39-28b6-481a-996e-22a668b9411c' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:53:01.274214 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:01.403899 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:53:01.404298 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:53:01.407410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5d2aab-6fa4-4a8b-9eac-c3300b29d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8e6d39-28b6-481a-996e-22a668b9411c', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.409611 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4855bbaa-505b-44d4-b735-f6ee1e9554e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:01.427242 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Volume volume-bb8e6d39-28b6-481a-996e-22a668b9411c (bb8e6d39-28b6-481a-996e-22a668b9411c): created successfully Nov 27 20:53:01.429501 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4855bbaa-505b-44d4-b735-f6ee1e9554e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:01.433080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Flow 'volume_create_manager' (3f4bdcad-205c-4394-8463-c566516d5a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:01.454229 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1106b346-68f2-4c1e-93c0-c8b7f6cf038f tempest-VolumesAdminNegativeTest-1676413609 None] Created volume successfully. Nov 27 20:53:02.683479 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-92e149ad-4031-4891-b011-f9e4e1a23463 req-3d31fdfd-77fa-48ad-aaf1-b1acd5a991ff tempest-VolumesAdminNegativeTest-1676413609 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:53:03.390078 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-92e149ad-4031-4891-b011-f9e4e1a23463 req-3d31fdfd-77fa-48ad-aaf1-b1acd5a991ff tempest-VolumesAdminNegativeTest-1676413609 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.706s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:53:03.391024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-92e149ad-4031-4891-b011-f9e4e1a23463 req-3d31fdfd-77fa-48ad-aaf1-b1acd5a991ff tempest-VolumesAdminNegativeTest-1676413609 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bb8e6d39-28b6-481a-996e-22a668b9411c', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'bb8e6d39-28b6-481a-996e-22a668b9411c', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:53:03.440329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-92e149ad-4031-4891-b011-f9e4e1a23463 req-3d31fdfd-77fa-48ad-aaf1-b1acd5a991ff tempest-VolumesAdminNegativeTest-1676413609 None] Connection info returned from driver {'name': 'volumes/volume-bb8e6d39-28b6-481a-996e-22a668b9411c', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bb8e6d39-28b6-481a-996e-22a668b9411c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '19158809-9d60-4f1b-af8a-2e17644b63ad'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:53:03.519687 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-92e149ad-4031-4891-b011-f9e4e1a23463 req-3d31fdfd-77fa-48ad-aaf1-b1acd5a991ff tempest-VolumesAdminNegativeTest-1676413609 None] attachment_update completed successfully. Nov 27 20:53:06.138781 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-2b3db021-365d-4045-abb8-a3ec0c38229a req-df262591-178d-4d8e-8312-1f442dcef7df tempest-AttachVolumeNegativeTest-36724854 None] Terminate volume connection completed successfully. Nov 27 20:53:06.140517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-2b3db021-365d-4045-abb8-a3ec0c38229a req-df262591-178d-4d8e-8312-1f442dcef7df tempest-AttachVolumeNegativeTest-36724854 None] Deleting attachment e7bc86ff-03da-482a-ba38-8470b10b32ea. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:53:07.668448 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-789fc9cc-7abb-40e7-903f-373f176a19b6 req-5ccf9eef-ef16-4e9e-ba78-09949e43f019 tempest-VolumesAdminNegativeTest-1676413609 None] Terminate volume connection completed successfully. Nov 27 20:53:07.669712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-789fc9cc-7abb-40e7-903f-373f176a19b6 req-5ccf9eef-ef16-4e9e-ba78-09949e43f019 tempest-VolumesAdminNegativeTest-1676413609 None] Deleting attachment 19158809-9d60-4f1b-af8a-2e17644b63ad. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:53:10.092605 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:53:10.102705 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:53:10.103350 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:53:10.183435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Flow 'volume_create_manager' (0604d56c-3bc0-410e-81e7-e8d6618e3444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:10.199563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf7380a-1453-413c-8f28-1694116ab995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.210136 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:53:10.251612 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf7380a-1453-413c-8f28-1694116ab995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-135279424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cb494ee-e52f-4464-965d-d331ccc0afdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57434a24104e95bcff0d4cabbd1419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:53:10Z,use_quota=True,user_id='9de6e0419e7843089302fa399e9e56aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.260172 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4beed86-9965-4fa0-aca7-4d9e99d3008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.263450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4beed86-9965-4fa0-aca7-4d9e99d3008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.271905 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6666fa76-99ac-4b22-a150-78a2704f06d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.284299 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6666fa76-99ac-4b22-a150-78a2704f06d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb494ee-e52f-4464-965d-d331ccc0afdc', 'volume_name': 'volume-7cb494ee-e52f-4464-965d-d331ccc0afdc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.292407 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008cab88-27fc-4e88-b2bc-fb3733d528a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.299089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008cab88-27fc-4e88-b2bc-fb3733d528a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.302737 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de02eb6-661c-4146-9ed4-3c0e24f863e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.303609 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Volume 7cb494ee-e52f-4464-965d-d331ccc0afdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb494ee-e52f-4464-965d-d331ccc0afdc', 'volume_size': 1} Nov 27 20:53:10.304022 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] creating volume 'volume-7cb494ee-e52f-4464-965d-d331ccc0afdc' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:53:10.309794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:10.466298 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:53:10.467087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:53:10.470322 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de02eb6-661c-4146-9ed4-3c0e24f863e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb494ee-e52f-4464-965d-d331ccc0afdc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.472946 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d652342-1a5c-4ed3-b78d-402ab2ba867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:10.492661 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Volume volume-7cb494ee-e52f-4464-965d-d331ccc0afdc (7cb494ee-e52f-4464-965d-d331ccc0afdc): created successfully Nov 27 20:53:10.495353 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d652342-1a5c-4ed3-b78d-402ab2ba867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:10.500184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Flow 'volume_create_manager' (0604d56c-3bc0-410e-81e7-e8d6618e3444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:10.519379 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2137eadd-bd42-403c-a844-83ab33edc1d4 tempest-VolumesAdminNegativeTest-1676413609 None] Created volume successfully. Nov 27 20:53:11.548331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Lock "b'cinder-7cb494ee-e52f-4464-965d-d331ccc0afdc-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:53:11.615780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:11.699916 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:53:11.700740 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Volume volume-7cb494ee-e52f-4464-965d-d331ccc0afdc is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:53:11.717246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] deleting rbd volume volume-7cb494ee-e52f-4464-965d-d331ccc0afdc {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:53:12.163187 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Created reservations ['0367eb03-31ce-429d-91ff-2c079918801f', '04a69d0c-7f1d-4156-8dd9-3d5bd2aa3544', '7e1b9b93-6a9a-4539-9059-3f23142b950b', '0f33fdde-01ab-4f3b-94b5-176bd569d6cc'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:53:12.251574 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:12.321251 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:12.407401 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:53:12.419510 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Deleted volume successfully. Nov 27 20:53:12.475980 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eca61d1e-153e-4dab-bcec-c829950a887d tempest-VolumesAdminNegativeTest-1676413609 None] Lock "b'cinder-7cb494ee-e52f-4464-965d-d331ccc0afdc-delete_volume'" released by "delete_volume" :: held 0.927s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:53:12.717952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Lock "b'cinder-bb8e6d39-28b6-481a-996e-22a668b9411c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:53:12.800063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:12.888321 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:53:12.888790 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Volume volume-bb8e6d39-28b6-481a-996e-22a668b9411c is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:53:12.896293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] deleting rbd volume volume-bb8e6d39-28b6-481a-996e-22a668b9411c {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:53:13.359850 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Created reservations ['2c1cc2e9-1787-4993-bda9-86e315cbf06b', '6314ada8-09c5-43b1-92b6-3427b73f8561', '202f30c9-0905-4471-9e89-e5b01b7fa2c2', '11ccb1fe-13ab-423e-a94a-f29774fd4d3d'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:53:13.474741 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:13.543528 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:13.651724 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:53:13.659854 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Deleted volume successfully. Nov 27 20:53:13.679808 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a0f104bd-cd09-451c-9028-fb42e32cf595 tempest-VolumesAdminNegativeTest-1676413609 None] Lock "b'cinder-bb8e6d39-28b6-481a-996e-22a668b9411c-delete_volume'" released by "delete_volume" :: held 0.962s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:53:28.662843 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:53:28.671622 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:53:28.673376 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:53:28.700113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (163caf6f-91a5-4f15-a2bb-7afe9604044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:28.711325 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6978a4ef-4f5d-4b1e-9411-bba260980c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.729163 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:53:28.743700 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6978a4ef-4f5d-4b1e-9411-bba260980c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1741394791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1d8a7fd-96da-4769-831b-93e5469edd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79226c480677428e924a69a8e4c01ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:53:29Z,use_quota=True,user_id='6f940822793e422c8436036be6a116a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.747016 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3d1eec-c9fa-496d-9723-c865c7e51933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.750043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3d1eec-c9fa-496d-9723-c865c7e51933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.753408 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e9571-89bf-4d11-852c-70bec06c1794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.756702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e9571-89bf-4d11-852c-70bec06c1794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d8a7fd-96da-4769-831b-93e5469edd45', 'volume_name': 'volume-c1d8a7fd-96da-4769-831b-93e5469edd45', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.760270 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b82cf9-ef33-481e-9dfb-fdc4fa745f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.762656 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b82cf9-ef33-481e-9dfb-fdc4fa745f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.765788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279fe7e2-1ee2-41ac-8b46-337c5cc44442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.766969 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Volume c1d8a7fd-96da-4769-831b-93e5469edd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d8a7fd-96da-4769-831b-93e5469edd45', 'volume_size': 1} Nov 27 20:53:28.767624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] creating volume 'volume-c1d8a7fd-96da-4769-831b-93e5469edd45' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:53:28.771498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:28.887342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:53:28.888893 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:53:28.892347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279fe7e2-1ee2-41ac-8b46-337c5cc44442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d8a7fd-96da-4769-831b-93e5469edd45', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.895310 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dd4a6d-8605-46f6-afc3-f97034d2d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:53:28.911427 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-c1d8a7fd-96da-4769-831b-93e5469edd45 (c1d8a7fd-96da-4769-831b-93e5469edd45): created successfully Nov 27 20:53:28.913683 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dd4a6d-8605-46f6-afc3-f97034d2d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:53:28.922944 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (163caf6f-91a5-4f15-a2bb-7afe9604044b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:53:28.955232 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2b9b5dc7-5345-49cf-8256-edc1e937e477 tempest-AttachVolumeNegativeTest-36724854 None] Created volume successfully. Nov 27 20:53:30.748432 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-07a82113-660f-405b-98f6-66833fce6ee7 req-8628a79e-1be5-497e-acd7-3067de76cbc0 tempest-AttachVolumeNegativeTest-36724854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:53:31.938654 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-07a82113-660f-405b-98f6-66833fce6ee7 req-8628a79e-1be5-497e-acd7-3067de76cbc0 tempest-AttachVolumeNegativeTest-36724854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.190s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:53:31.939624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-07a82113-660f-405b-98f6-66833fce6ee7 req-8628a79e-1be5-497e-acd7-3067de76cbc0 tempest-AttachVolumeNegativeTest-36724854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1d8a7fd-96da-4769-831b-93e5469edd45', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'c1d8a7fd-96da-4769-831b-93e5469edd45', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:53:31.978583 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-07a82113-660f-405b-98f6-66833fce6ee7 req-8628a79e-1be5-497e-acd7-3067de76cbc0 tempest-AttachVolumeNegativeTest-36724854 None] Connection info returned from driver {'name': 'volumes/volume-c1d8a7fd-96da-4769-831b-93e5469edd45', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c1d8a7fd-96da-4769-831b-93e5469edd45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fbd9461d-cd1d-4fc8-9b4b-5295c4f5aca0'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:53:32.054455 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-07a82113-660f-405b-98f6-66833fce6ee7 req-8628a79e-1be5-497e-acd7-3067de76cbc0 tempest-AttachVolumeNegativeTest-36724854 None] attachment_update completed successfully. Nov 27 20:53:36.549596 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-2bf710fe-3f0b-44a4-876a-e96924d32e19 req-7fddf18c-64e8-4b27-9f3f-a34de05655b7 tempest-AttachVolumeNegativeTest-36724854 None] Terminate volume connection completed successfully. Nov 27 20:53:36.550278 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-2bf710fe-3f0b-44a4-876a-e96924d32e19 req-7fddf18c-64e8-4b27-9f3f-a34de05655b7 tempest-AttachVolumeNegativeTest-36724854 None] Deleting attachment fbd9461d-cd1d-4fc8-9b4b-5295c4f5aca0. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:53:57.876993 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:53:57.877978 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:57.968415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:53:58.084277 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:54:00.340389 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:54:00.377291 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:54:00.380192 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:54:00.418434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (015ec71f-e1c6-44fd-a7e3-d291669025e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:54:00.424177 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a3a97d-c23f-49b7-bed5-9883119bf5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.442376 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:54:00.474416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a3a97d-c23f-49b7-bed5-9883119bf5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-570764033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60217ada-e1c1-41d9-8800-666d6b70b099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79226c480677428e924a69a8e4c01ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:54:00Z,use_quota=True,user_id='6f940822793e422c8436036be6a116a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.481889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913e496a-1acf-4cf0-babd-3851232bd8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.485562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913e496a-1acf-4cf0-babd-3851232bd8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.496400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc323572-7a0b-4474-af4c-88b1b1c82ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.502663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc323572-7a0b-4474-af4c-88b1b1c82ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60217ada-e1c1-41d9-8800-666d6b70b099', 'volume_name': 'volume-60217ada-e1c1-41d9-8800-666d6b70b099', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.510079 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136f51ca-dd24-4be1-8646-3b3730c73e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.523469 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136f51ca-dd24-4be1-8646-3b3730c73e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.528992 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10433f64-55ed-4f93-bb0f-00aeff24b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.529983 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Volume 60217ada-e1c1-41d9-8800-666d6b70b099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60217ada-e1c1-41d9-8800-666d6b70b099', 'volume_size': 1} Nov 27 20:54:00.533927 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] creating volume 'volume-60217ada-e1c1-41d9-8800-666d6b70b099' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:54:00.536497 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:00.691293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:54:00.692117 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:54:00.694567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10433f64-55ed-4f93-bb0f-00aeff24b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60217ada-e1c1-41d9-8800-666d6b70b099', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.697023 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d21627-95d2-4353-906e-2811768507e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:54:00.727474 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-60217ada-e1c1-41d9-8800-666d6b70b099 (60217ada-e1c1-41d9-8800-666d6b70b099): created successfully Nov 27 20:54:00.730104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d21627-95d2-4353-906e-2811768507e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:54:00.736338 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Flow 'volume_create_manager' (015ec71f-e1c6-44fd-a7e3-d291669025e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:54:00.760369 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d8604a0c-ce98-4631-86e5-9a6397f855f3 tempest-AttachVolumeNegativeTest-36724854 None] Created volume successfully. Nov 27 20:54:01.926583 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-bbe1315e-ae0d-4780-8794-fa8af5743d7b req-543118a4-8b70-4a81-ba56-8d09933af804 tempest-AttachVolumeNegativeTest-36724854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:54:03.208826 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-bbe1315e-ae0d-4780-8794-fa8af5743d7b req-543118a4-8b70-4a81-ba56-8d09933af804 tempest-AttachVolumeNegativeTest-36724854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.284s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:54:03.209558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bbe1315e-ae0d-4780-8794-fa8af5743d7b req-543118a4-8b70-4a81-ba56-8d09933af804 tempest-AttachVolumeNegativeTest-36724854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-60217ada-e1c1-41d9-8800-666d6b70b099', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '60217ada-e1c1-41d9-8800-666d6b70b099', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:54:03.240740 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-bbe1315e-ae0d-4780-8794-fa8af5743d7b req-543118a4-8b70-4a81-ba56-8d09933af804 tempest-AttachVolumeNegativeTest-36724854 None] Connection info returned from driver {'name': 'volumes/volume-60217ada-e1c1-41d9-8800-666d6b70b099', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '60217ada-e1c1-41d9-8800-666d6b70b099', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a29d28fc-7b35-49dc-85c9-ae0051ba8605'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:54:03.346863 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-bbe1315e-ae0d-4780-8794-fa8af5743d7b req-543118a4-8b70-4a81-ba56-8d09933af804 tempest-AttachVolumeNegativeTest-36724854 None] attachment_update completed successfully. Nov 27 20:54:06.816187 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef req-fe92ce02-6b62-4bd6-82b3-54b889d86d81 tempest-AttachVolumeNegativeTest-36724854 None] Terminate volume connection completed successfully. Nov 27 20:54:06.818196 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef req-fe92ce02-6b62-4bd6-82b3-54b889d86d81 tempest-AttachVolumeNegativeTest-36724854 None] Deleting attachment a29d28fc-7b35-49dc-85c9-ae0051ba8605. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:54:08.230871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-60217ada-e1c1-41d9-8800-666d6b70b099-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:54:08.280891 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:08.399780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:54:08.400787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-60217ada-e1c1-41d9-8800-666d6b70b099 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:54:08.412802 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] deleting rbd volume volume-60217ada-e1c1-41d9-8800-666d6b70b099 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:54:08.918343 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Created reservations ['d5ae92cb-a10c-4c0f-9d05-ae78c30affb0', 'a266175c-ffc7-4a02-8e94-7976f8a8166a', '25456d6b-85ca-4385-b091-99dcdbcf8b2c', '45a98c27-66a2-4217-8d37-8f2324c4b7b4'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:54:09.033564 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:09.101430 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:09.159028 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:54:09.180160 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Deleted volume successfully. Nov 27 20:54:09.209448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-40971664-ac7a-477d-9a18-6df63d6da658 tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-60217ada-e1c1-41d9-8800-666d6b70b099-delete_volume'" released by "delete_volume" :: held 0.979s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:54:15.042183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-c1d8a7fd-96da-4769-831b-93e5469edd45-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:54:15.151813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:15.253810 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:54:15.254021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-c1d8a7fd-96da-4769-831b-93e5469edd45 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:54:15.266975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] deleting rbd volume volume-c1d8a7fd-96da-4769-831b-93e5469edd45 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:54:15.753026 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Created reservations ['b924a428-18a8-4621-b2d7-a6862a1edbea', '9ee384e3-8746-43dd-808e-75f10a81c3e9', 'baef1fc1-f13a-4373-94fc-c6c2627b8eb6', 'cd451309-b34f-45ec-81e0-100f09119b02'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:54:15.823664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:15.908329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:15.988426 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:54:15.993602 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Deleted volume successfully. Nov 27 20:54:16.012965 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-879a87fd-bc15-47cf-a271-f338e13639cb tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-c1d8a7fd-96da-4769-831b-93e5469edd45-delete_volume'" released by "delete_volume" :: held 0.970s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:54:25.690546 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-cad55e6f-4b88-4111-9cfb-0a54a768ecde-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:54:25.733458 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:25.815275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:54:25.815649 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Volume volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:54:25.827692 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] deleting rbd volume volume-cad55e6f-4b88-4111-9cfb-0a54a768ecde {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:54:26.182452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Created reservations ['14f580cd-90f0-4b99-a889-1cd9c68571c0', '4913aa60-74b2-4b2b-a8bb-e211a03336d8', 'db9d9fc5-8034-4ee7-80f4-14acc49352ab', '97010cff-ad26-44cb-ae55-15fcbb77083f'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:54:26.242230 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:26.279483 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:26.314769 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:54:26.320007 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Deleted volume successfully. Nov 27 20:54:26.332878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6d6564f2-4e72-4bc8-8317-4800ca70deec tempest-AttachVolumeNegativeTest-36724854 None] Lock "b'cinder-cad55e6f-4b88-4111-9cfb-0a54a768ecde-delete_volume'" released by "delete_volume" :: held 0.642s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:54:57.880440 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:54:57.882182 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:57.968016 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:54:58.050276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:55:02.770624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:55:02.792139 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:55:02.796658 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:55:02.867288 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (095645cd-9248-4560-b248-ba459dc471a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:02.873226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f5b71-dac0-495f-a431-4cc13e243c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:02.902628 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:55:02.946925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f5b71-dac0-495f-a431-4cc13e243c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1657502084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=021a76d9-22a2-4682-b594-1eb66d6d2882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f19e09c6b04ac1a559d52d9cad1c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:55:03Z,use_quota=True,user_id='05f09b6a534240fc82a45ce979040e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:02.953330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eec96d8-5933-4d3b-bdb1-124f7d56701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:02.959939 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eec96d8-5933-4d3b-bdb1-124f7d56701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:02.967772 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcac41a-8074-4176-8c7e-a49ea1c4768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:03.190305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcac41a-8074-4176-8c7e-a49ea1c4768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '021a76d9-22a2-4682-b594-1eb66d6d2882', 'volume_name': 'volume-021a76d9-22a2-4682-b594-1eb66d6d2882', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:03.192736 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de19a11-f751-4987-a7ac-6a12ea26f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:03.196367 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de19a11-f751-4987-a7ac-6a12ea26f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:03.207446 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd76b2a-06be-4ed2-8497-11016615004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:03.212820 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume 021a76d9-22a2-4682-b594-1eb66d6d2882: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-021a76d9-22a2-4682-b594-1eb66d6d2882', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 20:55:03.213448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Cloning 021a76d9-22a2-4682-b594-1eb66d6d2882 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 20:55:03.264037 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.050s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:55:03.290631 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 55, 3, 277766)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:55:03.292011 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:55:03.292832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 20:55:03.318539 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:55:03.334953 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 20:55:03.351231 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 55, 3, 346434)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:55:03.353800 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:55:03.354433 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 20:55:03.383034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:55:03.560790 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] creating snapshot='volume-021a76d9-22a2-4682-b594-1eb66d6d2882.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 20:55:04.364292 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-021a76d9-22a2-4682-b594-1eb66d6d2882.clone_snap' to 'volume-021a76d9-22a2-4682-b594-1eb66d6d2882' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 20:55:04.638919 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:55:04.641260 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:55:04.642129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:55:04.675114 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 20:55:04.676365 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Marking volume 021a76d9-22a2-4682-b594-1eb66d6d2882 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 20:55:04.687517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 021a76d9-22a2-4682-b594-1eb66d6d2882. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 20:55:04.689544 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Creating volume glance metadata for volume 021a76d9-22a2-4682-b594-1eb66d6d2882 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 20:55:04.827502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd76b2a-06be-4ed2-8497-11016615004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021a76d9-22a2-4682-b594-1eb66d6d2882', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:04.847114 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae784d44-d33b-4d46-ad6c-d2618cf68a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:04.874446 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-021a76d9-22a2-4682-b594-1eb66d6d2882 (021a76d9-22a2-4682-b594-1eb66d6d2882): created successfully Nov 27 20:55:04.890076 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae784d44-d33b-4d46-ad6c-d2618cf68a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:04.894819 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (095645cd-9248-4560-b248-ba459dc471a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:04.931904 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-46628353-99a8-42a9-83f4-ef7112e1e2e8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Created volume successfully. Nov 27 20:55:06.505355 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:55:06.510004 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:55:06.510657 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:55:06.524041 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (9bee05e1-6d32-4ccf-8a9b-a886ac802835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:06.527847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e846390-0bec-4319-8ed9-2ed8bd301743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.534447 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:55:06.553722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e846390-0bec-4319-8ed9-2ed8bd301743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-689811465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b8f6b91-0f5d-43af-b670-f5ec500355d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f19e09c6b04ac1a559d52d9cad1c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:55:06Z,use_quota=True,user_id='05f09b6a534240fc82a45ce979040e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.557791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf8ec4d-3657-4977-8cc1-d5650eb9d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.561677 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf8ec4d-3657-4977-8cc1-d5650eb9d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.565273 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd3964b-abf8-4691-b806-f3fc78841f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.568629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd3964b-abf8-4691-b806-f3fc78841f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'volume_name': 'volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.571308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfdfa6b-e2b4-4856-9c0f-ee97b60f912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.575384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfdfa6b-e2b4-4856-9c0f-ee97b60f912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.577843 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9a45aa-c7c2-484b-88fc-72bd791663f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.579139 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume 7b8f6b91-0f5d-43af-b670-f5ec500355d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'volume_size': 1} Nov 27 20:55:06.579602 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] creating volume 'volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:55:06.580836 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:55:06.682214 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:55:06.682606 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:55:06.685702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9a45aa-c7c2-484b-88fc-72bd791663f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.688131 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb6479-d730-4a75-9759-8d81d95a9658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:06.699068 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4 (7b8f6b91-0f5d-43af-b670-f5ec500355d4): created successfully Nov 27 20:55:06.703120 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb6479-d730-4a75-9759-8d81d95a9658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:06.708860 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (9bee05e1-6d32-4ccf-8a9b-a886ac802835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:06.724072 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fb6204e8-f3a3-4c0a-af29-474574d0d28f tempest-TaggedBootDevicesTest_v242-2000740141 None] Created volume successfully. Nov 27 20:55:07.868015 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:55:07.872806 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:55:07.873472 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:55:07.885669 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (c0090650-2c5e-463c-be0a-a7c9426ac814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:07.890270 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d20350-708a-4b70-96f5-e8d0142d7261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:07.897106 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:55:07.911078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d20350-708a-4b70-96f5-e8d0142d7261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-866315089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9acdff48-832d-43c1-a2c9-2c6d43a6f9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f19e09c6b04ac1a559d52d9cad1c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:55:08Z,use_quota=True,user_id='05f09b6a534240fc82a45ce979040e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:07.914383 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347ea9d9-f0fd-4126-9191-c57231e9758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:07.916804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347ea9d9-f0fd-4126-9191-c57231e9758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:07.919852 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7012b4-5a20-4e8d-9b53-21d06a8a3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:07.922385 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7012b4-5a20-4e8d-9b53-21d06a8a3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'volume_name': 'volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:07.924870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f6b784-6011-4221-9364-aa2715098284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:07.926973 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f6b784-6011-4221-9364-aa2715098284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:07.929241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5298a266-2b98-439b-b583-f2e42909c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:07.930023 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume 9acdff48-832d-43c1-a2c9-2c6d43a6f9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'volume_size': 1} Nov 27 20:55:07.930610 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] creating volume 'volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:55:07.931915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:55:08.018440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:55:08.018915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:55:08.021141 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5298a266-2b98-439b-b583-f2e42909c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:08.023883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be41b0-a508-40e6-a18f-f0911f434b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:55:08.033910 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da (9acdff48-832d-43c1-a2c9-2c6d43a6f9da): created successfully Nov 27 20:55:08.037025 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be41b0-a508-40e6-a18f-f0911f434b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:55:08.041027 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Flow 'volume_create_manager' (c0090650-2c5e-463c-be0a-a7c9426ac814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:55:08.052883 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-10943a97-2dd6-4a6c-b09d-af72c83db1cf tempest-TaggedBootDevicesTest_v242-2000740141 None] Created volume successfully. Nov 27 20:55:34.725670 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-62cdd9a7-51ef-4bc8-abdb-90d906d49862 tempest-TaggedBootDevicesTest_v242-2000740141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:55:35.933784 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-62cdd9a7-51ef-4bc8-abdb-90d906d49862 tempest-TaggedBootDevicesTest_v242-2000740141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.207s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:55:35.935894 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-35825a72-095e-41a6-bfdc-f28a36363933 req-62cdd9a7-51ef-4bc8-abdb-90d906d49862 tempest-TaggedBootDevicesTest_v242-2000740141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-021a76d9-22a2-4682-b594-1eb66d6d2882', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '021a76d9-22a2-4682-b594-1eb66d6d2882', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:55:35.991470 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-62cdd9a7-51ef-4bc8-abdb-90d906d49862 tempest-TaggedBootDevicesTest_v242-2000740141 None] Connection info returned from driver {'name': 'volumes/volume-021a76d9-22a2-4682-b594-1eb66d6d2882', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '021a76d9-22a2-4682-b594-1eb66d6d2882', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9dd26b34-5e3d-413a-9b02-1b457dfbf005'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:55:36.126130 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-62cdd9a7-51ef-4bc8-abdb-90d906d49862 tempest-TaggedBootDevicesTest_v242-2000740141 None] attachment_update completed successfully. Nov 27 20:55:36.725344 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-ea529e89-d7d1-4a79-b574-790f9d8c0980 tempest-TaggedBootDevicesTest_v242-2000740141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:55:37.998189 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-ea529e89-d7d1-4a79-b574-790f9d8c0980 tempest-TaggedBootDevicesTest_v242-2000740141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.272s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:55:37.999815 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-35825a72-095e-41a6-bfdc-f28a36363933 req-ea529e89-d7d1-4a79-b574-790f9d8c0980 tempest-TaggedBootDevicesTest_v242-2000740141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:55:38.061943 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-ea529e89-d7d1-4a79-b574-790f9d8c0980 tempest-TaggedBootDevicesTest_v242-2000740141 None] Connection info returned from driver {'name': 'volumes/volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b8f6b91-0f5d-43af-b670-f5ec500355d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b85d9744-6734-4268-b199-2f6ffdec68fc'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:55:38.174398 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-ea529e89-d7d1-4a79-b574-790f9d8c0980 tempest-TaggedBootDevicesTest_v242-2000740141 None] attachment_update completed successfully. Nov 27 20:55:38.727023 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-a71d3e87-0992-47af-8019-d282efd0e5a8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:55:40.296983 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-35825a72-095e-41a6-bfdc-f28a36363933 req-a71d3e87-0992-47af-8019-d282efd0e5a8 tempest-TaggedBootDevicesTest_v242-2000740141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.570s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:55:40.297949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-35825a72-095e-41a6-bfdc-f28a36363933 req-a71d3e87-0992-47af-8019-d282efd0e5a8 tempest-TaggedBootDevicesTest_v242-2000740141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:55:40.334036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-a71d3e87-0992-47af-8019-d282efd0e5a8 tempest-TaggedBootDevicesTest_v242-2000740141 None] Connection info returned from driver {'name': 'volumes/volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9acdff48-832d-43c1-a2c9-2c6d43a6f9da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e8dd1864-1b9a-4e40-8a99-d3662f5a4d6e'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:55:40.431638 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-35825a72-095e-41a6-bfdc-f28a36363933 req-a71d3e87-0992-47af-8019-d282efd0e5a8 tempest-TaggedBootDevicesTest_v242-2000740141 None] attachment_update completed successfully. Nov 27 20:55:57.885318 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:55:57.886609 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:55:57.941754 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:55:57.999492 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:56:35.378917 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:35.391473 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:35.395627 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:35.482179 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (b40363ec-6981-49db-999c-3907421c0735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:35.491713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bab3fbb-da1a-4050-93b3-b54853e08025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.513555 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:35.532075 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bab3fbb-da1a-4050-93b3-b54853e08025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-518134934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95f9b732-81b6-4bd4-8cb1-f126d3291900,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dfbe03e6096449783e6909fbae314bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:35Z,use_quota=True,user_id='3395780dcbad4113990572d4936153de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.539347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0c9c4-668f-4926-92f7-50d22b7ccb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.545421 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0c9c4-668f-4926-92f7-50d22b7ccb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.551170 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba1cd41-363a-4212-b064-208b93669863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.561177 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba1cd41-363a-4212-b064-208b93669863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f9b732-81b6-4bd4-8cb1-f126d3291900', 'volume_name': 'volume-95f9b732-81b6-4bd4-8cb1-f126d3291900', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.564885 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da96da59-ed1c-4228-8a21-7493bc665408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.567783 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da96da59-ed1c-4228-8a21-7493bc665408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.570282 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47e4926-8fb7-492a-918d-22f5e2ce08d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.571325 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Volume 95f9b732-81b6-4bd4-8cb1-f126d3291900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f9b732-81b6-4bd4-8cb1-f126d3291900', 'volume_size': 1} Nov 27 20:56:35.571995 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] creating volume 'volume-95f9b732-81b6-4bd4-8cb1-f126d3291900' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:56:35.573223 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:35.709082 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:35.709753 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:35.713065 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47e4926-8fb7-492a-918d-22f5e2ce08d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f9b732-81b6-4bd4-8cb1-f126d3291900', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.715486 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661740b6-4f7d-409a-9645-31b94bd012be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:35.738170 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Volume volume-95f9b732-81b6-4bd4-8cb1-f126d3291900 (95f9b732-81b6-4bd4-8cb1-f126d3291900): created successfully Nov 27 20:56:35.740470 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661740b6-4f7d-409a-9645-31b94bd012be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:35.743930 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (b40363ec-6981-49db-999c-3907421c0735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:35.761238 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-79637336-2570-45f3-9bd9-4e6a9cfbc15a tempest-VolumesTestJSON-1175875664 None] Created volume successfully. Nov 27 20:56:37.266834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:37.270312 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:37.286962 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:37.357109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (bb939b4a-4360-4e2e-bec7-ddcd6afdc9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:37.363464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ef749d-eb85-4d4b-b99c-a9000446aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.378511 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:37.402170 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ef749d-eb85-4d4b-b99c-a9000446aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1341330999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=017cc740-160e-4436-b5fe-9bea1135da69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dfbe03e6096449783e6909fbae314bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:37Z,use_quota=True,user_id='3395780dcbad4113990572d4936153de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.405772 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8f90d7-6b7c-4563-bd04-c1021c6d8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.408831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8f90d7-6b7c-4563-bd04-c1021c6d8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.412957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1613326a-2631-4043-ba71-0af881dbfcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.416438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1613326a-2631-4043-ba71-0af881dbfcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017cc740-160e-4436-b5fe-9bea1135da69', 'volume_name': 'volume-017cc740-160e-4436-b5fe-9bea1135da69', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.419508 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03252935-1af8-4a1d-9301-be00051fb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.422863 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03252935-1af8-4a1d-9301-be00051fb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.425434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23c5c59-e7a6-4589-9eb1-d0a34289b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.426968 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Volume 017cc740-160e-4436-b5fe-9bea1135da69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017cc740-160e-4436-b5fe-9bea1135da69', 'volume_size': 1} Nov 27 20:56:37.427609 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] creating volume 'volume-017cc740-160e-4436-b5fe-9bea1135da69' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:56:37.429074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:37.622050 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:37.622493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:37.625310 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23c5c59-e7a6-4589-9eb1-d0a34289b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017cc740-160e-4436-b5fe-9bea1135da69', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.627808 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1854b4b-889e-4461-9fa9-cc37cf0eef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:37.646433 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Volume volume-017cc740-160e-4436-b5fe-9bea1135da69 (017cc740-160e-4436-b5fe-9bea1135da69): created successfully Nov 27 20:56:37.648726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1854b4b-889e-4461-9fa9-cc37cf0eef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:37.656470 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (bb939b4a-4360-4e2e-bec7-ddcd6afdc9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:37.676808 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-52f41034-5e54-410f-a042-d0f557aedb02 tempest-VolumesTestJSON-1175875664 None] Created volume successfully. Nov 27 20:56:39.358836 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:39.366037 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:39.373978 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:39.420877 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (954da6af-88ed-4521-a971-b9a9197d29bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:39.450677 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877cfdbd-8aa2-4a89-8717-b0490ba256a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.466200 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:39.493100 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877cfdbd-8aa2-4a89-8717-b0490ba256a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-783422231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dfbe03e6096449783e6909fbae314bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:39Z,use_quota=True,user_id='3395780dcbad4113990572d4936153de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.502007 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740c00b3-fa83-4bd0-9d25-13e60b354884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.516226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740c00b3-fa83-4bd0-9d25-13e60b354884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.528097 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b1ad41-6431-4b1b-a40d-551fa51e095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.532385 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b1ad41-6431-4b1b-a40d-551fa51e095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf', 'volume_name': 'volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.538042 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5612b24e-b8b0-48e6-97ff-1eaab2e93f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.542058 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5612b24e-b8b0-48e6-97ff-1eaab2e93f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.554174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f143a89a-9301-4712-9861-7f29421da49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.556365 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Volume 070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf', 'volume_size': 1} Nov 27 20:56:39.556946 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] creating volume 'volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:56:39.558455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:39.741931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:39.742608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:39.744913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f143a89a-9301-4712-9861-7f29421da49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.753878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da5589-af98-4ddc-b99b-b85d87451d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:39.773195 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Volume volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf (070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf): created successfully Nov 27 20:56:39.779183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da5589-af98-4ddc-b99b-b85d87451d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:39.800676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Flow 'volume_create_manager' (954da6af-88ed-4521-a971-b9a9197d29bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:39.814642 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2b10cad8-cc79-445d-ab2b-2bc1f5a36504 tempest-VolumesTestJSON-1175875664 None] Created volume successfully. Nov 27 20:56:42.072752 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:56:42.151768 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:42.246842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:56:42.247693 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Volume volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:56:42.273625 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] deleting rbd volume volume-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:56:42.856614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Created reservations ['106ff59a-ab7c-45c9-b188-1394bbdcb687', 'dc511e73-5f3f-48a9-a879-ab939ba10e1e', '4601ca91-9234-4d1f-8655-eeb0f0aaee98', '3954c6fb-3bd0-41e7-b9e0-d158508671d2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:56:43.026353 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:43.135928 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:43.221108 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:56:43.250206 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Deleted volume successfully. Nov 27 20:56:43.291651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c46c1409-a529-4655-896e-dd3202daa368 tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf-delete_volume'" released by "delete_volume" :: held 1.219s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:56:43.417859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-017cc740-160e-4436-b5fe-9bea1135da69-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:56:43.501320 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:43.618194 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:56:43.619373 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Volume volume-017cc740-160e-4436-b5fe-9bea1135da69 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:56:43.635262 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] deleting rbd volume volume-017cc740-160e-4436-b5fe-9bea1135da69 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:56:43.970624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:43.976035 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:43.976825 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:44.001948 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Flow 'volume_create_manager' (c2578046-9495-4d93-a4d1-40c6083c43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:44.006415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfe6047-30bc-4afb-a34d-452138fc3307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:44.014866 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:44.032531 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfe6047-30bc-4afb-a34d-452138fc3307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1735315119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=067f2dc6-20d2-42a1-bd57-6f30654d22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7860bb78a8bc43fd80d4c01ce057e5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:44Z,use_quota=True,user_id='dcb3f0e11efd43278f9c4c34f7eda52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:44.035615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2464e936-76fe-44df-b49a-35dc71484ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:44.038410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2464e936-76fe-44df-b49a-35dc71484ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:44.042436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f37f3c4-99de-4577-9b1c-c6ffba6595fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:44.141135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Created reservations ['d51f2c88-826d-4cea-a260-721c49294143', 'ab9c759b-6ecd-4799-ae6f-9b1e55591c51', '1432750c-7ebb-493d-b6a4-96cde9234928', '6c57286d-120f-4109-8db1-fcec921e30d1'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:56:44.211957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:44.307285 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:44.363801 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:56:44.370576 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Deleted volume successfully. Nov 27 20:56:44.401602 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f37f3c4-99de-4577-9b1c-c6ffba6595fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'volume_name': 'volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:44.405130 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d3ec1-265f-461c-99d8-11206d7c8fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:44.407790 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7d3ec1-265f-461c-99d8-11206d7c8fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:44.411428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b46fb2c-dd52-4de8-a853-97f427f1a520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:44.412723 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Volume 067f2dc6-20d2-42a1-bd57-6f30654d22f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 20:56:44.413614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Cloning 067f2dc6-20d2-42a1-bd57-6f30654d22f3 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 20:56:44.438399 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0e8ff051-3cf0-4ae8-b8b4-04612862090b tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-017cc740-160e-4436-b5fe-9bea1135da69-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:56:44.454970 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.040s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:56:44.471945 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 56, 44, 460225)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:56:44.472513 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:56:44.476510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 20:56:44.485654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:56:44.487127 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 20:56:44.494644 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 56, 44, 490759)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:56:44.495129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:56:44.495602 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 20:56:44.555758 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:44.658437 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] creating snapshot='volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 20:56:45.504706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3.clone_snap' to 'volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 20:56:45.542958 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-95f9b732-81b6-4bd4-8cb1-f126d3291900-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:56:45.608690 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:45.698063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:56:45.698507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Volume volume-95f9b732-81b6-4bd4-8cb1-f126d3291900 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:56:45.718671 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] deleting rbd volume volume-95f9b732-81b6-4bd4-8cb1-f126d3291900 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:56:45.773362 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:56:45.775598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:45.775598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:45.835598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 20:56:45.836913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Marking volume 067f2dc6-20d2-42a1-bd57-6f30654d22f3 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 20:56:45.855156 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 067f2dc6-20d2-42a1-bd57-6f30654d22f3. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 20:56:45.855653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Creating volume glance metadata for volume 067f2dc6-20d2-42a1-bd57-6f30654d22f3 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 20:56:46.033565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b46fb2c-dd52-4de8-a853-97f427f1a520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:46.045887 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9680e621-1a94-4a76-bd7c-9b74dd7b2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:46.073832 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Volume volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3 (067f2dc6-20d2-42a1-bd57-6f30654d22f3): created successfully Nov 27 20:56:46.076681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9680e621-1a94-4a76-bd7c-9b74dd7b2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:46.083972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Flow 'volume_create_manager' (c2578046-9495-4d93-a4d1-40c6083c43c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:46.103340 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9d530e51-9ea5-44d9-80ae-28b21944b7ac tempest-ServersTestBootFromVolume-9867946 None] Created volume successfully. Nov 27 20:56:46.312663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Created reservations ['57fe2979-0c67-4fe6-984d-febb53e97103', '174045f7-08d5-4485-85c7-54c7e5995cab', '2e614007-0e95-4012-ac9c-f15dfeae6710', '912e3613-e2aa-4249-8c29-c85cee7dcac2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:56:46.394278 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:46.472047 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:46.554400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:56:46.560819 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Deleted volume successfully. Nov 27 20:56:46.582126 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-2e150be1-70f0-4fb7-8783-161a5d153331 tempest-VolumesTestJSON-1175875664 None] Lock "b'cinder-95f9b732-81b6-4bd4-8cb1-f126d3291900-delete_volume'" released by "delete_volume" :: held 1.045s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:56:47.128726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:47.136247 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:47.136998 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:47.172563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (86ec49bd-9750-42c4-8652-775ebb0eb589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:47.185064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53587cd-3b1d-436c-b341-7f434e151267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:47.197472 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:47.221106 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53587cd-3b1d-436c-b341-7f434e151267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1213913390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=caa38af6-5178-4b65-9a06-d11b9f7b1114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03be159839446f2a47ca07f13bb552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:47Z,use_quota=True,user_id='8e7695cf8df749e9af62b1746e818ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:47.229800 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09be27f-760e-4e24-82db-653237c2f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:47.236061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09be27f-760e-4e24-82db-653237c2f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:47.251337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408b197-3959-4efb-919d-a1c45c75ca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:47.404590 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3408b197-3959-4efb-919d-a1c45c75ca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'caa38af6-5178-4b65-9a06-d11b9f7b1114', 'volume_name': 'volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:47.409881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03da13e-f145-454d-9a82-cfb90a9b8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:47.412936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03da13e-f145-454d-9a82-cfb90a9b8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:47.425927 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cab5e0-120a-440a-b516-225f452e4d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:47.427177 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Volume caa38af6-5178-4b65-9a06-d11b9f7b1114: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 20:56:47.427968 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Cloning caa38af6-5178-4b65-9a06-d11b9f7b1114 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 20:56:47.448761 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:56:47.488952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 56, 47, 468533)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:56:47.489436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:56:47.490241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 20:56:47.504020 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.055s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:56:47.507655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 20:56:47.538697 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 20, 56, 47, 524083)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 20:56:47.539648 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 20:56:47.540896 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 20:56:47.562632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:47.657063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] creating snapshot='volume-caa38af6-5178-4b65-9a06-d11b9f7b1114.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 20:56:48.621148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-caa38af6-5178-4b65-9a06-d11b9f7b1114.clone_snap' to 'volume-caa38af6-5178-4b65-9a06-d11b9f7b1114' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 20:56:48.950024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 20:56:48.951558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:48.952608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:49.016438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 20:56:49.022585 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Marking volume caa38af6-5178-4b65-9a06-d11b9f7b1114 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 20:56:49.044070 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to caa38af6-5178-4b65-9a06-d11b9f7b1114. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 20:56:49.045999 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Creating volume glance metadata for volume caa38af6-5178-4b65-9a06-d11b9f7b1114 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 20:56:49.265348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cab5e0-120a-440a-b516-225f452e4d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:49.269874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b671f3-3929-4b52-89e8-220c1e24754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:49.293054 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-caa38af6-5178-4b65-9a06-d11b9f7b1114 (caa38af6-5178-4b65-9a06-d11b9f7b1114): created successfully Nov 27 20:56:49.297008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b671f3-3929-4b52-89e8-220c1e24754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:49.304061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (86ec49bd-9750-42c4-8652-775ebb0eb589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:49.321510 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-20868b4d-a652-4e18-8607-18a5f439c449 tempest-TaggedBootDevicesTest-1441186917 None] Created volume successfully. Nov 27 20:56:51.296139 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:51.303199 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:51.303984 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:51.327158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (40b43803-0c37-4746-92d6-228213ff648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:51.332265 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aec1c3-512a-4674-9e7c-d3440db9087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.342839 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:51.409659 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aec1c3-512a-4674-9e7c-d3440db9087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1600107707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10ddafcd-c9e0-437c-8d6e-29009b4bedca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03be159839446f2a47ca07f13bb552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:51Z,use_quota=True,user_id='8e7695cf8df749e9af62b1746e818ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.422498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b278e6-58e9-4866-b29f-b691915b0425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.434200 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b278e6-58e9-4866-b29f-b691915b0425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.438161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07c47d5-c83f-4e7c-b2fd-884edbd154a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.454663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07c47d5-c83f-4e7c-b2fd-884edbd154a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'volume_name': 'volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.461744 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76027651-e864-4ddc-97e7-f6ffefc71ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.474650 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76027651-e864-4ddc-97e7-f6ffefc71ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.480740 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2fcbdf-da1e-4b03-97f1-f6e2b0b33231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.481833 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Volume 10ddafcd-c9e0-437c-8d6e-29009b4bedca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'volume_size': 1} Nov 27 20:56:51.482627 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] creating volume 'volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:56:51.484260 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:51.674801 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:51.675524 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:51.678672 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2fcbdf-da1e-4b03-97f1-f6e2b0b33231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.682098 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd88d14-a0c2-4f42-8287-56d734eeee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:51.703903 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca (10ddafcd-c9e0-437c-8d6e-29009b4bedca): created successfully Nov 27 20:56:51.706779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd88d14-a0c2-4f42-8287-56d734eeee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:51.713699 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (40b43803-0c37-4746-92d6-228213ff648c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:51.732968 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ecd5f291-84ba-4ada-b6d3-5579e7adb849 tempest-TaggedBootDevicesTest-1441186917 None] Created volume successfully. Nov 27 20:56:52.218557 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 req-2edef724-2137-453e-b85a-cd1ed2fdc3da tempest-ServersTestBootFromVolume-9867946 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:56:53.091147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:56:53.100910 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:56:53.103989 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:56:53.129872 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (525986ad-1f59-4e18-b2fc-d7dd69dde69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:53.148256 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ef393-f104-4b18-92d0-4bbfc7575676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.160206 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:56:53.185129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ef393-f104-4b18-92d0-4bbfc7575676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-109550983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d68e4828-a000-482f-90e9-83e87b933855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03be159839446f2a47ca07f13bb552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:56:53Z,use_quota=True,user_id='8e7695cf8df749e9af62b1746e818ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.197428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03eda10-527d-4ec3-a062-fd70a4f6bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.200166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03eda10-527d-4ec3-a062-fd70a4f6bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.203661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2194df-77b6-4f0a-9ed5-5d087b426c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.211950 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2194df-77b6-4f0a-9ed5-5d087b426c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68e4828-a000-482f-90e9-83e87b933855', 'volume_name': 'volume-d68e4828-a000-482f-90e9-83e87b933855', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.221329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3487d3-c1c8-4956-a6ae-7e91cec2b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.224480 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3487d3-c1c8-4956-a6ae-7e91cec2b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.233881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaad64d-46b7-42ff-973b-72991628a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.235660 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Volume d68e4828-a000-482f-90e9-83e87b933855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68e4828-a000-482f-90e9-83e87b933855', 'volume_size': 1} Nov 27 20:56:53.236246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] creating volume 'volume-d68e4828-a000-482f-90e9-83e87b933855' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:56:53.238563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:53.448477 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:56:53.449116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:56:53.451572 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaad64d-46b7-42ff-973b-72991628a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68e4828-a000-482f-90e9-83e87b933855', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.453975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746bb4bb-f8c3-4f8d-b63d-9747d0d00a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:56:53.476992 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-d68e4828-a000-482f-90e9-83e87b933855 (d68e4828-a000-482f-90e9-83e87b933855): created successfully Nov 27 20:56:53.480703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746bb4bb-f8c3-4f8d-b63d-9747d0d00a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:56:53.484762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Flow 'volume_create_manager' (525986ad-1f59-4e18-b2fc-d7dd69dde69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:56:53.508241 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-768c9b4e-f7c4-48d7-814d-f7d024eb7dcd tempest-TaggedBootDevicesTest-1441186917 None] Created volume successfully. Nov 27 20:56:53.994433 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 req-2edef724-2137-453e-b85a-cd1ed2fdc3da tempest-ServersTestBootFromVolume-9867946 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.776s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:56:53.995307 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 req-2edef724-2137-453e-b85a-cd1ed2fdc3da tempest-ServersTestBootFromVolume-9867946 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:56:54.063481 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 req-2edef724-2137-453e-b85a-cd1ed2fdc3da tempest-ServersTestBootFromVolume-9867946 None] Connection info returned from driver {'name': 'volumes/volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '067f2dc6-20d2-42a1-bd57-6f30654d22f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '392ad60d-78cb-4e81-8b95-73058c964416'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:56:54.157073 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 req-2edef724-2137-453e-b85a-cd1ed2fdc3da tempest-ServersTestBootFromVolume-9867946 None] attachment_update completed successfully. Nov 27 20:56:57.885760 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:56:57.886668 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:57.971794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:56:58.057809 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:57:21.216614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 20:57:21.233063 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 20:57:21.236005 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 20:57:21.271209 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Flow 'volume_create_manager' (0d823f01-539e-4867-adf0-d9ddcf6f8861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:57:21.285720 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125947e7-7f79-414a-8999-1b9bcd0bb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.300609 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:57:21.339089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125947e7-7f79-414a-8999-1b9bcd0bb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1904702897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f986e2f-d4ac-4ed5-a12e-42ce18715da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376670c463284dec902268e55ba60b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T20:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T20:57:21Z,use_quota=True,user_id='ed87ef17973a49f2a9108bdfbff65415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.342426 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58048e8f-01ae-4b7b-8929-20440fc45a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.344981 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58048e8f-01ae-4b7b-8929-20440fc45a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.355900 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e928f58-d7cd-40ad-9e79-926ed6612ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.368465 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e928f58-d7cd-40ad-9e79-926ed6612ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'volume_name': 'volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.373665 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5b3b1-d72d-4346-86c7-2305525359a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.376000 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5b3b1-d72d-4346-86c7-2305525359a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.378252 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d330ceb-1e8d-41c8-b668-e9470af95316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.379059 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Volume 3f986e2f-d4ac-4ed5-a12e-42ce18715da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'volume_size': 1} Nov 27 20:57:21.399509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] creating volume 'volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 20:57:21.400734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:57:21.571851 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 20:57:21.573313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 20:57:21.585416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d330ceb-1e8d-41c8-b668-e9470af95316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.593869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ee15f8-a049-4c8d-a8ff-934356c50608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 20:57:21.613216 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Volume volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5 (3f986e2f-d4ac-4ed5-a12e-42ce18715da5): created successfully Nov 27 20:57:21.620310 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ee15f8-a049-4c8d-a8ff-934356c50608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 20:57:21.637634 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Flow 'volume_create_manager' (0d823f01-539e-4867-adf0-d9ddcf6f8861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 20:57:21.657843 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-12f8f03c-538e-4abd-b366-dd5c5749834c tempest-DeleteServersTestJSON-1501646271 None] Created volume successfully. Nov 27 20:57:23.028525 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c req-f0d67aed-980b-4dce-ac71-b6cf63b5ddc4 tempest-DeleteServersTestJSON-1501646271 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:57:24.121086 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c req-f0d67aed-980b-4dce-ac71-b6cf63b5ddc4 tempest-DeleteServersTestJSON-1501646271 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.094s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:57:24.124287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c req-f0d67aed-980b-4dce-ac71-b6cf63b5ddc4 tempest-DeleteServersTestJSON-1501646271 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:57:24.199314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c req-f0d67aed-980b-4dce-ac71-b6cf63b5ddc4 tempest-DeleteServersTestJSON-1501646271 None] Connection info returned from driver {'name': 'volumes/volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3f986e2f-d4ac-4ed5-a12e-42ce18715da5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b75cb69d-9615-454c-95a7-b5a8aa3e0e08'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:57:24.274814 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c req-f0d67aed-980b-4dce-ac71-b6cf63b5ddc4 tempest-DeleteServersTestJSON-1501646271 None] attachment_update completed successfully. Nov 27 20:57:24.945248 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-6e76b74b-1306-406a-9114-90535195fe64 tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:57:26.305368 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-6e76b74b-1306-406a-9114-90535195fe64 tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.362s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:57:26.307870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-6e76b74b-1306-406a-9114-90535195fe64 tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'caa38af6-5178-4b65-9a06-d11b9f7b1114', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:57:26.370314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-6e76b74b-1306-406a-9114-90535195fe64 tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'caa38af6-5178-4b65-9a06-d11b9f7b1114', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9a34bd96-f3a4-450f-96bb-8320078f18da'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:57:26.503795 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-6e76b74b-1306-406a-9114-90535195fe64 tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:57:26.980995 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-3c3ec141-f6b4-4c97-a7d0-4516f4116fc3 tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:57:28.466962 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-3c3ec141-f6b4-4c97-a7d0-4516f4116fc3 tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.486s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:57:28.469920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-3c3ec141-f6b4-4c97-a7d0-4516f4116fc3 tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:57:28.529331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-3c3ec141-f6b4-4c97-a7d0-4516f4116fc3 tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd11c2a73-7977-4815-9172-b5672be2c23c'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:57:28.635201 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-3c3ec141-f6b4-4c97-a7d0-4516f4116fc3 tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:57:29.144618 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-07f56ec6-ee20-4f85-8f6b-968ac83d5ced tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:57:30.165512 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-07f56ec6-ee20-4f85-8f6b-968ac83d5ced tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.026s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:57:30.167557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-07f56ec6-ee20-4f85-8f6b-968ac83d5ced tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d68e4828-a000-482f-90e9-83e87b933855', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'd68e4828-a000-482f-90e9-83e87b933855', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:57:30.201681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-07f56ec6-ee20-4f85-8f6b-968ac83d5ced tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-d68e4828-a000-482f-90e9-83e87b933855', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd68e4828-a000-482f-90e9-83e87b933855', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '433d24a5-32cb-4036-a305-56351c8926d0'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:57:30.282868 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-07f56ec6-ee20-4f85-8f6b-968ac83d5ced tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:57:32.051766 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 req-975739d5-7fbd-4313-8a36-21c84fcde878 tempest-DeleteServersTestJSON-1501646271 None] Terminate volume connection completed successfully. Nov 27 20:57:32.057003 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 req-975739d5-7fbd-4313-8a36-21c84fcde878 tempest-DeleteServersTestJSON-1501646271 None] Deleting attachment b75cb69d-9615-454c-95a7-b5a8aa3e0e08. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:57:57.892532 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:57:57.894388 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:57:57.972943 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:57:58.004770 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:58:57.890152 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:58:57.892671 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:58:57.984312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:58:58.068587 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:59:00.369242 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-ea688186-3fff-4c9f-9cc9-eab376834c72 tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 20:59:00.377007 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-ea688186-3fff-4c9f-9cc9-eab376834c72 tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment 9a34bd96-f3a4-450f-96bb-8320078f18da. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:59:00.610803 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-add76ef7-c565-4bce-bbb8-a8be1895e825 tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 20:59:00.612395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-add76ef7-c565-4bce-bbb8-a8be1895e825 tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment d11c2a73-7977-4815-9172-b5672be2c23c. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:59:00.868527 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-c828f49e-c33c-4f03-a05d-f9c367bddafe tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 20:59:00.875143 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-c828f49e-c33c-4f03-a05d-f9c367bddafe tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment 433d24a5-32cb-4036-a305-56351c8926d0. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:59:16.993592 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-8ad8f7e7-694d-4e59-b23f-5aca6da4b808 tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:59:18.662194 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-8ad8f7e7-694d-4e59-b23f-5aca6da4b808 tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.668s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:59:18.664684 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-8ad8f7e7-694d-4e59-b23f-5aca6da4b808 tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'caa38af6-5178-4b65-9a06-d11b9f7b1114', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:59:18.709154 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-8ad8f7e7-694d-4e59-b23f-5aca6da4b808 tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-caa38af6-5178-4b65-9a06-d11b9f7b1114', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'caa38af6-5178-4b65-9a06-d11b9f7b1114', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7079ef06-7b47-4c5c-83c6-0bb37c31a743'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:59:18.790451 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-8ad8f7e7-694d-4e59-b23f-5aca6da4b808 tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:59:19.183392 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-090c424e-48ab-4e3f-bf85-24e35b776519 tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:59:20.171013 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-090c424e-48ab-4e3f-bf85-24e35b776519 tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.987s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:59:20.172599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-090c424e-48ab-4e3f-bf85-24e35b776519 tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:59:20.199035 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-090c424e-48ab-4e3f-bf85-24e35b776519 tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10ddafcd-c9e0-437c-8d6e-29009b4bedca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6bb5b733-5858-4b8a-98bb-7850619d4d85'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:59:20.266431 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-090c424e-48ab-4e3f-bf85-24e35b776519 tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:59:20.717497 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-59814dca-7513-48f7-ad6a-c79ff9ef6723 tempest-TaggedBootDevicesTest-1441186917 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:59:21.571459 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-59814dca-7513-48f7-ad6a-c79ff9ef6723 tempest-TaggedBootDevicesTest-1441186917 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.854s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:59:21.572765 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-59814dca-7513-48f7-ad6a-c79ff9ef6723 tempest-TaggedBootDevicesTest-1441186917 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d68e4828-a000-482f-90e9-83e87b933855', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'd68e4828-a000-482f-90e9-83e87b933855', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 20:59:21.600781 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-59814dca-7513-48f7-ad6a-c79ff9ef6723 tempest-TaggedBootDevicesTest-1441186917 None] Connection info returned from driver {'name': 'volumes/volume-d68e4828-a000-482f-90e9-83e87b933855', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd68e4828-a000-482f-90e9-83e87b933855', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '393d9f22-9d95-424b-8723-369b234af8ba'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 20:59:21.662338 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 req-59814dca-7513-48f7-ad6a-c79ff9ef6723 tempest-TaggedBootDevicesTest-1441186917 None] attachment_update completed successfully. Nov 27 20:59:43.774013 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-996d1ae5-3917-4995-a308-4f658209ad92 tempest-ServersTestBootFromVolume-9867946 None] Terminate volume connection completed successfully. Nov 27 20:59:43.775428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-996d1ae5-3917-4995-a308-4f658209ad92 tempest-ServersTestBootFromVolume-9867946 None] Deleting attachment 392ad60d-78cb-4e81-8b95-73058c964416. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 20:59:44.093394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] Lock "b'cinder-067f2dc6-20d2-42a1-bd57-6f30654d22f3-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 20:59:44.164804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:59:44.301339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 20:59:44.324469 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] deleting rbd volume volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 20:59:44.927506 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 20:59:44.977431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] deleting parent snapshot volume-067f2dc6-20d2-42a1-bd57-6f30654d22f3.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 20:59:45.883374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] Created reservations ['bed6524b-c7f7-4591-bd5c-9265fe3495ab', '98f83938-70b2-4bab-bf6c-c47d54322868', '24936664-7a33-43af-b7e0-0829c9a44acb', '5be3cd02-f2da-4d49-a2cf-f0ac9e4849af'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 20:59:45.984838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:59:46.046082 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:59:46.090975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 20:59:46.097648 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] Deleted volume successfully. Nov 27 20:59:46.116324 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-d0fa6714-41c0-4425-ab89-60029602ce21 req-59d8a9d9-b088-42a1-a729-0c08c8df14dc tempest-ServersTestBootFromVolume-9867946 None] Lock "b'cinder-067f2dc6-20d2-42a1-bd57-6f30654d22f3-delete_volume'" released by "delete_volume" :: held 2.025s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 20:59:57.889367 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 20:59:57.890128 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:59:57.980122 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 20:59:58.104118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:00:51.087819 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Lock "b'cinder-3f986e2f-d4ac-4ed5-a12e-42ce18715da5-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:00:51.197954 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:00:51.336060 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:00:51.336565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Volume volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:00:51.349689 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] deleting rbd volume volume-3f986e2f-d4ac-4ed5-a12e-42ce18715da5 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:00:52.085816 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Created reservations ['650dc64d-6fa3-4b8c-891d-6d2b819610a3', 'b150dd7c-296c-4d06-8593-e163c0fae9a8', '360eaa04-a072-4cfb-ab01-89e0eb52ac79', '25066109-20b9-4a15-803b-50db37ef28e5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:00:52.171979 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:00:52.270697 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:00:52.379174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:00:52.384255 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Deleted volume successfully. Nov 27 21:00:52.404569 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4cf1acd1-628b-4658-961e-89612695517b tempest-DeleteServersTestJSON-1501646271 None] Lock "b'cinder-3f986e2f-d4ac-4ed5-a12e-42ce18715da5-delete_volume'" released by "delete_volume" :: held 1.315s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:00:57.891201 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:00:57.891907 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:00:57.961019 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:00:58.027936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:01:02.868466 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:01:02.873169 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:01:02.873661 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:01:02.901306 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Flow 'volume_create_manager' (78d120ae-6376-40c6-9e71-336c30bf73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:02.904467 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc04bce-8456-4278-ae4e-2a9caab63e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:02.914862 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:01:02.942189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc04bce-8456-4278-ae4e-2a9caab63e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1993030948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92ccb174-0ba3-45f5-a80e-0c50959a00fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f19d8aeeda0a4c2db52a980daa542a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:01:03Z,use_quota=True,user_id='93681e22fe044deabb09dee1c32b9699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:02.946017 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a102ea4-af8b-4880-a5f0-a8d17e24eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:02.949518 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a102ea4-af8b-4880-a5f0-a8d17e24eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:02.953581 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fbf464-923b-493f-938b-dd8c98f86ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:02.957827 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fbf464-923b-493f-938b-dd8c98f86ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ccb174-0ba3-45f5-a80e-0c50959a00fc', 'volume_name': 'volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:02.961635 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b183fbf5-029f-4003-9b05-1f8718539464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:02.965396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b183fbf5-029f-4003-9b05-1f8718539464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:02.970073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150f7bd-97ca-42d8-9bd2-3f3d10167a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:02.971277 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Volume 92ccb174-0ba3-45f5-a80e-0c50959a00fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc', 'volume_size': 1} Nov 27 21:01:02.971952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] creating volume 'volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:01:02.973195 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:03.121423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:01:03.123073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:01:03.127044 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150f7bd-97ca-42d8-9bd2-3f3d10167a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:03.130000 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ff2c8-4e80-456f-8bf7-45f69a14a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:03.143170 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Volume volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc (92ccb174-0ba3-45f5-a80e-0c50959a00fc): created successfully Nov 27 21:01:03.146351 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ff2c8-4e80-456f-8bf7-45f69a14a94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:03.150154 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Flow 'volume_create_manager' (78d120ae-6376-40c6-9e71-336c30bf73c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:03.167938 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-11f4dc3c-aa07-4928-bd9b-0b6b26452eb0 tempest-VolumesServicesTestJSON-1754698975 None] Created volume successfully. Nov 27 21:01:04.129957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Lock "b'cinder-92ccb174-0ba3-45f5-a80e-0c50959a00fc-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:01:04.182985 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:04.280446 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:01:04.282284 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Volume volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:01:04.299747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] deleting rbd volume volume-92ccb174-0ba3-45f5-a80e-0c50959a00fc {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:01:04.840303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Created reservations ['f6b730da-4fa7-4f71-9d99-272029cd5111', '8b7e3886-3ad9-408e-be63-e45bbbc736e4', '8838ce52-d162-4474-ac06-c77029e39365', '0a249303-1d3f-4452-b985-3b6a557a965a'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:01:04.901093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:04.946541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:05.009705 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:01:05.016940 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Deleted volume successfully. Nov 27 21:01:05.045982 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cc2df3e6-536d-4f07-ae64-e2eccb636f3e tempest-VolumesServicesTestJSON-1754698975 None] Lock "b'cinder-92ccb174-0ba3-45f5-a80e-0c50959a00fc-delete_volume'" released by "delete_volume" :: held 0.915s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:01:21.975756 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:01:22.008522 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:01:22.008522 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:01:22.075792 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Flow 'volume_create_manager' (e4884a4d-81f7-498f-8a2f-ada8d02ae331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:22.099189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e78568-6ff9-4c92-84ef-d3bea925c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.130181 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:01:22.229188 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e78568-6ff9-4c92-84ef-d3bea925c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1530453070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be623256-283d-45cf-85d9-7c1e6a7c0ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cbe9c9e7934de8b8ef807c135e69e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:01:22Z,use_quota=True,user_id='faed6b4fee944522a19b4721fa335af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.237276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02124ce7-799d-4377-9086-bee6f6e204a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.241416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02124ce7-799d-4377-9086-bee6f6e204a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.245309 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b5fd7a-32d7-4ed9-8baf-be31a5afa130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.248814 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b5fd7a-32d7-4ed9-8baf-be31a5afa130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be623256-283d-45cf-85d9-7c1e6a7c0ddc', 'volume_name': 'volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.252029 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3339fb-7eae-4def-9a97-39d19db91f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.258341 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3339fb-7eae-4def-9a97-39d19db91f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.261514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784f9827-18a3-4f97-b9ed-a98799e29c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.262802 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Volume be623256-283d-45cf-85d9-7c1e6a7c0ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc', 'volume_size': 1} Nov 27 21:01:22.263421 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] creating volume 'volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:01:22.268321 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:22.509678 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:01:22.510766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:01:22.518852 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784f9827-18a3-4f97-b9ed-a98799e29c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.523837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6788fc69-ae5a-45fa-a965-a59750765889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:22.551228 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Volume volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc (be623256-283d-45cf-85d9-7c1e6a7c0ddc): created successfully Nov 27 21:01:22.558166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6788fc69-ae5a-45fa-a965-a59750765889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:22.576511 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Flow 'volume_create_manager' (e4884a4d-81f7-498f-8a2f-ada8d02ae331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:22.626602 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0319efab-2093-41fe-9551-c1125a8f9069 tempest-VolumesDeleteCascade-1132104761 None] Created volume successfully. Nov 27 21:01:23.783875 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5f714f46-eec0-4090-b866-ced3f455c85c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:25.065675 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5f714f46-eec0-4090-b866-ced3f455c85c tempest-VolumesDeleteCascade-1132104761 None] Create snapshot completed successfully Nov 27 21:01:26.354938 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e57d5890-b40f-40f1-9d3c-cbe1878568e4 tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:27.177344 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e57d5890-b40f-40f1-9d3c-cbe1878568e4 tempest-VolumesDeleteCascade-1132104761 None] Create snapshot completed successfully Nov 27 21:01:27.645118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-be623256-283d-45cf-85d9-7c1e6a7c0ddc-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:01:27.752675 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Performing cascade delete. {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Nov 27 21:01:27.793730 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-6772f9c5-746d-4f59-9af3-7626947d9605-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:01:27.816427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:29.151444 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:01:29.259881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Created reservations ['6d596f97-43da-4e1b-8abc-277333552758', 'ad196b28-4b6b-40e5-a9bc-497cca6d4652', 'b8f91cc0-6684-4954-87bf-c12a7ba7a8c3', 'ac56843f-7e2a-429d-b55b-660e71572f2c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:01:29.361612 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Delete snapshot completed successfully. Nov 27 21:01:29.370456 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-6772f9c5-746d-4f59-9af3-7626947d9605-delete_snapshot'" released by "delete_snapshot" :: held 1.577s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:01:29.401345 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-e3d20087-f9a3-4200-a1d4-b55a8431c216-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:01:29.439515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:30.194287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Created reservations ['c6071056-88d1-4e41-a715-aa81fb08bea1', '0c2842d4-30fe-4d31-b257-21c513fbafd0', '26fc294f-0c47-4ee9-a72d-f5a76ca733ba', 'bd3211d8-af7d-457c-8204-47ccab019ccf'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:01:30.243155 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Delete snapshot completed successfully. Nov 27 21:01:30.257152 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-e3d20087-f9a3-4200-a1d4-b55a8431c216-delete_snapshot'" released by "delete_snapshot" :: held 0.855s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:01:30.258797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Snapshots deleted, issuing volume delete {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Nov 27 21:01:30.260535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:30.343878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:01:30.344352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Volume volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:01:30.362742 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] deleting rbd volume volume-be623256-283d-45cf-85d9-7c1e6a7c0ddc {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:01:30.843314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Created reservations ['d8453629-79f4-40ba-a0ef-65433ffd5805', '507fd900-2665-4f73-8218-ec7e7b43020c', '9a01f5a2-1b95-4720-a1d6-04b9c2e102cb', 'bbede07c-8fb2-4e5e-9493-ba3bb34e5c55'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:01:30.926785 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:30.998491 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:31.062176 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:01:31.073132 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Deleted volume successfully. Nov 27 21:01:31.091562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c9d769fe-af4c-4648-9ebc-f35fafe3ec2c tempest-VolumesDeleteCascade-1132104761 None] Lock "b'cinder-be623256-283d-45cf-85d9-7c1e6a7c0ddc-delete_volume'" released by "delete_volume" :: held 3.447s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:01:35.022802 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:01:35.028352 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:01:35.029096 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:01:35.046515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Flow 'volume_create_manager' (44a5cb1d-9ec5-4794-9536-1cdfbc9019f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:35.050577 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b37b15-06c6-4f05-95c1-cbc7c524db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.057927 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:01:35.074314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b37b15-06c6-4f05-95c1-cbc7c524db58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-457473941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd943139-704a-4031-a3c5-1cc1313ef277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58285bdf2f7f42828b92f58257662c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:01:35Z,use_quota=True,user_id='40318ccb06044be792566a1f518427ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.077780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b1f7d3-e55d-4df7-b4db-b99a3e5c56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.080536 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b1f7d3-e55d-4df7-b4db-b99a3e5c56cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.083358 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1c8abe-bea7-48e7-bb19-d88caeafc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.086090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1c8abe-bea7-48e7-bb19-d88caeafc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd943139-704a-4031-a3c5-1cc1313ef277', 'volume_name': 'volume-dd943139-704a-4031-a3c5-1cc1313ef277', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.091913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88df6872-48d2-4d4b-9bcd-41d58a1b94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.097016 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88df6872-48d2-4d4b-9bcd-41d58a1b94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.100066 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0bb962-4460-4988-b25d-ee2c9990563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.101142 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Volume dd943139-704a-4031-a3c5-1cc1313ef277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd943139-704a-4031-a3c5-1cc1313ef277', 'volume_size': 1} Nov 27 21:01:35.101834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] creating volume 'volume-dd943139-704a-4031-a3c5-1cc1313ef277' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:01:35.103396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:35.320986 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:01:35.321788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:01:35.324190 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0bb962-4460-4988-b25d-ee2c9990563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd943139-704a-4031-a3c5-1cc1313ef277', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.331888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7909f37d-e4ea-4285-b0fd-c046e10dd2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:01:35.353481 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Volume volume-dd943139-704a-4031-a3c5-1cc1313ef277 (dd943139-704a-4031-a3c5-1cc1313ef277): created successfully Nov 27 21:01:35.356415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7909f37d-e4ea-4285-b0fd-c046e10dd2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:01:35.362450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Flow 'volume_create_manager' (44a5cb1d-9ec5-4794-9536-1cdfbc9019f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:01:35.385639 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee6fbd86-c1a0-4b7b-9cbe-f3b92772b55e tempest-VolumesMetadataTest-1138272427 None] Created volume successfully. Nov 27 21:01:37.355733 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Lock "b'cinder-dd943139-704a-4031-a3c5-1cc1313ef277-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:01:37.441565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:37.543104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:01:37.543104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Volume volume-dd943139-704a-4031-a3c5-1cc1313ef277 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:01:37.557257 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] deleting rbd volume volume-dd943139-704a-4031-a3c5-1cc1313ef277 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:01:38.112567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Created reservations ['bd6102ec-0f1c-48c6-81c9-1c5227a20008', '088b9fd3-1153-4286-aa31-389eab7b8b13', '65f51d31-a2ed-43b1-b008-77a792906b8e', '8bf2b4f4-bd4b-4721-a39b-119f49e0e17f'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:01:38.166202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:38.242586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:38.293774 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:01:38.299359 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Deleted volume successfully. Nov 27 21:01:38.320848 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0b418c22-0596-4ecf-bc8a-e7eb8c1c944e tempest-VolumesMetadataTest-1138272427 None] Lock "b'cinder-dd943139-704a-4031-a3c5-1cc1313ef277-delete_volume'" released by "delete_volume" :: held 0.966s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:01:57.894714 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:01:57.895573 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:57.963585 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:01:58.064833 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:02:47.775797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:02:47.784418 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:02:47.785014 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:02:47.798050 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Flow 'volume_create_manager' (b204a6f4-d7de-4ce2-9160-494c8a161e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:02:47.801895 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd025a6-9733-4b9a-b601-f9b10722e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:47.810024 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:02:47.827555 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd025a6-9733-4b9a-b601-f9b10722e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-382167737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80a5bb1b-01cc-4cd5-8cc8-2614826723a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c58aa2d3dd4e09a26b5265084b8493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:02:48Z,use_quota=True,user_id='9a60782e0d8945c2b99dac616fda491d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:47.831207 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8eccb5-a300-4202-a734-f1fc83e79594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:47.834357 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8eccb5-a300-4202-a734-f1fc83e79594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:47.837844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35eab54-80c3-4bbe-9bd1-91416c6c0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:47.846835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35eab54-80c3-4bbe-9bd1-91416c6c0635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a5bb1b-01cc-4cd5-8cc8-2614826723a2', 'volume_name': 'volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:47.849970 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630a7a88-25c1-4ca4-a59c-80f86398a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:47.853633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630a7a88-25c1-4ca4-a59c-80f86398a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:47.856830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933564b4-b1e1-4574-a12e-6dc3703a86b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:47.857926 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Volume 80a5bb1b-01cc-4cd5-8cc8-2614826723a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2', 'volume_size': 1} Nov 27 21:02:47.858929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] creating volume 'volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:02:47.860337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:02:48.007286 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:02:48.007286 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:02:48.009691 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933564b4-b1e1-4574-a12e-6dc3703a86b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:48.012681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec54a188-7644-4ebb-9111-9a4218099308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:48.033176 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Volume volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2 (80a5bb1b-01cc-4cd5-8cc8-2614826723a2): created successfully Nov 27 21:02:48.035488 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec54a188-7644-4ebb-9111-9a4218099308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:48.039058 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Flow 'volume_create_manager' (b204a6f4-d7de-4ce2-9160-494c8a161e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:02:48.055106 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-62715a62-49bc-41d1-bd57-0c044e3f58a6 tempest-ServersNegativeTestJSON-5863557 None] Created volume successfully. Nov 27 21:02:51.027756 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:02:51.032006 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:02:51.032462 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:02:51.063064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Flow 'volume_create_manager' (a0815fef-a9c4-42b6-8ef8-4beab259796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:02:51.070233 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac683e70-94bc-4c4f-bea8-545fca6d3e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.081244 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:02:51.111618 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac683e70-94bc-4c4f-bea8-545fca6d3e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1821075688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80d0ddd8-7411-489b-8c3c-7a9be3ba1b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c58aa2d3dd4e09a26b5265084b8493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:02:51Z,use_quota=True,user_id='9a60782e0d8945c2b99dac616fda491d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.114638 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0efde3-fe25-4a68-b64d-327a19424ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.126930 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0efde3-fe25-4a68-b64d-327a19424ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.134374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0150c4bb-ecc4-4d22-ae90-fd2ecdd23898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.137514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0150c4bb-ecc4-4d22-ae90-fd2ecdd23898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d0ddd8-7411-489b-8c3c-7a9be3ba1b98', 'volume_name': 'volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.139916 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae5c4dc-deaf-4c32-b27a-775cd5757944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.151863 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae5c4dc-deaf-4c32-b27a-775cd5757944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.157330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526b7f8-88db-4749-aff2-1e484bc00478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.160318 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Volume 80d0ddd8-7411-489b-8c3c-7a9be3ba1b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98', 'volume_size': 1} Nov 27 21:02:51.160737 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] creating volume 'volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:02:51.161766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:02:51.306242 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:02:51.306625 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:02:51.309838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526b7f8-88db-4749-aff2-1e484bc00478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.312101 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e90a2ce-4149-4c0b-8b4b-03b599bbf16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:02:51.332980 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Volume volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98 (80d0ddd8-7411-489b-8c3c-7a9be3ba1b98): created successfully Nov 27 21:02:51.335488 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e90a2ce-4149-4c0b-8b4b-03b599bbf16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:02:51.338475 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Flow 'volume_create_manager' (a0815fef-a9c4-42b6-8ef8-4beab259796c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:02:51.363780 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c663057b-8197-41f8-a7fe-91a1c49ca829 tempest-ServersNegativeTestJSON-5863557 None] Created volume successfully. Nov 27 21:02:57.900842 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:02:57.902456 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:02:57.997987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:02:58.049579 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:03:57.904163 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:03:57.904163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:03:57.958722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:03:58.043350 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:04.960366 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:04.964775 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:04.965665 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:04.979830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (34d7f536-f9e0-459c-99d2-2b5c4866870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:04.982909 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988a3727-0c6a-4b4b-8e21-337b2b9592cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:04.989903 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:05.005047 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988a3727-0c6a-4b4b-8e21-337b2b9592cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-735871775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7666f2cb-ed7b-415d-98e1-749b9d9b0c74,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:05Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.007628 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfea347-26c5-430d-950b-6dc4c836f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:05.009806 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfea347-26c5-430d-950b-6dc4c836f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.012404 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c030a38-751a-4a7c-bd5c-9db96d072015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:05.014826 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c030a38-751a-4a7c-bd5c-9db96d072015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7666f2cb-ed7b-415d-98e1-749b9d9b0c74', 'volume_name': 'volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.017362 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b41af0f-b2e3-4391-9cb6-b4a41e183b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:05.019824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b41af0f-b2e3-4391-9cb6-b4a41e183b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.022415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c9fca6-2ae8-43ca-9484-e28b37dfb5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:05.023531 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Volume 7666f2cb-ed7b-415d-98e1-749b9d9b0c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74', 'volume_size': 1} Nov 27 21:04:05.023927 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] creating volume 'volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:05.024903 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:05.116782 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:05.118130 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:05.120559 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c9fca6-2ae8-43ca-9484-e28b37dfb5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.123068 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f88385-3d79-4200-b290-611b8bf6bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:05.134163 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Volume volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74 (7666f2cb-ed7b-415d-98e1-749b9d9b0c74): created successfully Nov 27 21:04:05.140767 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f88385-3d79-4200-b290-611b8bf6bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:05.143889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (34d7f536-f9e0-459c-99d2-2b5c4866870b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:05.155181 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1b055994-d7bd-4123-a33a-15dc804783be tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:06.762069 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:06.766996 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:06.767770 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:06.780538 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (cefffddb-5408-4755-9d22-430f9c97e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:06.785090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8057c47-50a8-474a-b73c-46f9815ba07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.792597 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:06.807611 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8057c47-50a8-474a-b73c-46f9815ba07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1835772855',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e78578c-bd08-455c-9a8e-5352c3958ce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:07Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.810532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d436bf1-cdd4-4f97-8b4a-45f3ba9a95f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.812929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d436bf1-cdd4-4f97-8b4a-45f3ba9a95f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.815600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee79e26d-a2f0-483d-850c-b4074c0742a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.818064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee79e26d-a2f0-483d-850c-b4074c0742a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e78578c-bd08-455c-9a8e-5352c3958ce2', 'volume_name': 'volume-8e78578c-bd08-455c-9a8e-5352c3958ce2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.820685 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b1cf1a-e90a-44d0-984a-cd28bddea69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.823305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b1cf1a-e90a-44d0-984a-cd28bddea69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.826086 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa971ed-a288-4441-b4ed-2f860754ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.826890 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Volume 8e78578c-bd08-455c-9a8e-5352c3958ce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e78578c-bd08-455c-9a8e-5352c3958ce2', 'volume_size': 1} Nov 27 21:04:06.827317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] creating volume 'volume-8e78578c-bd08-455c-9a8e-5352c3958ce2' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:06.828321 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:06.907178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:06.907565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:06.910475 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa971ed-a288-4441-b4ed-2f860754ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e78578c-bd08-455c-9a8e-5352c3958ce2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.912821 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea406c2-fd5c-41de-8ec0-54d649bbb08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:06.929933 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Volume volume-8e78578c-bd08-455c-9a8e-5352c3958ce2 (8e78578c-bd08-455c-9a8e-5352c3958ce2): created successfully Nov 27 21:04:06.932157 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea406c2-fd5c-41de-8ec0-54d649bbb08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:06.938881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (cefffddb-5408-4755-9d22-430f9c97e534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:06.950751 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-74c514c5-0513-4146-85d1-f3a18024a547 tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:07.907175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-8e78578c-bd08-455c-9a8e-5352c3958ce2-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:07.970382 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:08.055663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:08.056113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Volume volume-8e78578c-bd08-455c-9a8e-5352c3958ce2 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:08.063445 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-8e78578c-bd08-455c-9a8e-5352c3958ce2 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:08.484626 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Created reservations ['9cc59db1-3971-4c79-8a7c-bb2bf0721088', '3cd1e889-ca05-4cf2-ad49-0f8e38cffffb', '504d8492-8576-459f-a615-49038b93c1e5', '44620efc-3995-496c-b544-0b5b01bcda37'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:08.583320 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:08.640046 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:08.702019 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:08.706819 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:08.724858 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-92aa046d-8c1b-4a76-98d5-615d274683e1 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-8e78578c-bd08-455c-9a8e-5352c3958ce2-delete_volume'" released by "delete_volume" :: held 0.819s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:09.099501 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-7666f2cb-ed7b-415d-98e1-749b9d9b0c74-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:09.173136 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:09.268109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:09.268837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Volume volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:09.276903 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-7666f2cb-ed7b-415d-98e1-749b9d9b0c74 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:09.663029 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Created reservations ['226a8407-87b4-40f7-97c8-d80e702841c9', 'fc1edea2-d53e-4b94-b96f-a321f592fe52', 'f151ae91-a4ce-40c5-ab16-eaa1ee482a33', '50d63ad0-c121-4b89-819a-84007b3b8d81'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:09.711824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:09.747877 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:09.790110 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:09.795204 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:09.809859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6edf0b6e-73fc-419f-a0fe-2f0b621282e4 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-7666f2cb-ed7b-415d-98e1-749b9d9b0c74-delete_volume'" released by "delete_volume" :: held 0.710s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:10.645394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:10.650122 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:10.650801 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:10.664928 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (0e4f50fe-dcc0-4916-8ba8-725d2ffe1040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:10.669352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbb1ac7-1a5e-4c76-b183-aa9b47e74ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.676382 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:10.692189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbb1ac7-1a5e-4c76-b183-aa9b47e74ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-394591409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d82050bf-d0e7-41e3-a444-b1cd12ac2eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:11Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.695909 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bb4aa8-9384-47c7-beb4-9f50ca221004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.698498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bb4aa8-9384-47c7-beb4-9f50ca221004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.701578 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e93eb9-36f3-462a-be0b-1461450317f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.704262 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e93eb9-36f3-462a-be0b-1461450317f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'volume_name': 'volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.707074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51849a8-2cd1-429b-b322-de21efe3b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.713887 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51849a8-2cd1-429b-b322-de21efe3b802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.717043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e251996a-383f-4f7f-bfac-618be313f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.718038 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Volume d82050bf-d0e7-41e3-a444-b1cd12ac2eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'volume_size': 1} Nov 27 21:04:10.718596 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] creating volume 'volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:10.720043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:10.821594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:10.822723 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:10.826149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e251996a-383f-4f7f-bfac-618be313f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.838216 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9054b86f-a24b-4795-8f0d-2ab47b7ec6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:10.861885 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Volume volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9 (d82050bf-d0e7-41e3-a444-b1cd12ac2eb9): created successfully Nov 27 21:04:10.864653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9054b86f-a24b-4795-8f0d-2ab47b7ec6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:10.870031 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (0e4f50fe-dcc0-4916-8ba8-725d2ffe1040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:10.887332 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-77717569-39dc-403d-bfa5-852ce87639fd tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:12.248749 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:12.255187 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:12.255971 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:12.296036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (2498b5c1-4124-4c7a-a458-18f1ad7f61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:12.306499 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8138e5c-52c8-4a8e-90d8-c32df51af334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:12.327003 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:12.341986 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8138e5c-52c8-4a8e-90d8-c32df51af334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1486506925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=11874805-9715-4023-ba0e-0d90a2d4e4b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d82050bf-d0e7-41e3-a444-b1cd12ac2eb9,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:12Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:12.357957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6625459f-00db-4677-9788-8d77c41c3d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:12.362393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6625459f-00db-4677-9788-8d77c41c3d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:12.366856 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247bb0ee-cbd0-498e-9133-50672da570d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:12.419589 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247bb0ee-cbd0-498e-9133-50672da570d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '11874805-9715-4023-ba0e-0d90a2d4e4b3', 'volume_name': 'volume-11874805-9715-4023-ba0e-0d90a2d4e4b3', 'volume_size': 1, 'source_volid': 'd82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:12.423375 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1828453-35b3-4271-acf0-154ff4e2d541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:12.439442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1828453-35b3-4271-acf0-154ff4e2d541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:12.451904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda498a0-0db1-41be-a298-6bb151885fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:12.452771 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Volume 11874805-9715-4023-ba0e-0d90a2d4e4b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-11874805-9715-4023-ba0e-0d90a2d4e4b3', 'volume_size': 1, 'source_volid': 'd82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'source_volstatus': 'available'} Nov 27 21:04:12.501709 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:12.571636 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] creating snapshot='volume-11874805-9715-4023-ba0e-0d90a2d4e4b3.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:04:13.464312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] cloning 'volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9@volume-11874805-9715-4023-ba0e-0d90a2d4e4b3.clone_snap' to 'volume-11874805-9715-4023-ba0e-0d90a2d4e4b3' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:04:13.643689 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Volume volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:13.645124 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:13.645793 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:13.689178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:04:13.692355 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda498a0-0db1-41be-a298-6bb151885fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11874805-9715-4023-ba0e-0d90a2d4e4b3', 'volume_size': 1, 'source_volid': 'd82050bf-d0e7-41e3-a444-b1cd12ac2eb9', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:13.696091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f115b6-01f4-4226-9b8f-ba7c574c7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:13.712654 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Volume volume-11874805-9715-4023-ba0e-0d90a2d4e4b3 (11874805-9715-4023-ba0e-0d90a2d4e4b3): created successfully Nov 27 21:04:13.715346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f115b6-01f4-4226-9b8f-ba7c574c7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:13.718632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (2498b5c1-4124-4c7a-a458-18f1ad7f61ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:13.751435 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b2d96832-2588-438b-8fb0-8f2a6957de89 tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:15.525395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:15.544930 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:15.544930 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:15.597390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (4c876c8f-5a31-40f6-92f6-f6f37adcab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:15.600722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d26927-3d8b-4094-9e0e-b94c9f80e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.609437 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:15.649710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d26927-3d8b-4094-9e0e-b94c9f80e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468584460',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd437570-01df-4a93-ba53-f9a171f144d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:15Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.659274 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96a8cb4-daa6-4c8b-8a5b-657b153a5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.662704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96a8cb4-daa6-4c8b-8a5b-657b153a5b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.667957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8f399c-69a8-4b5d-add5-34810bd1ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.670363 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8f399c-69a8-4b5d-add5-34810bd1ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd437570-01df-4a93-ba53-f9a171f144d1', 'volume_name': 'volume-fd437570-01df-4a93-ba53-f9a171f144d1', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.693908 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052988d3-9e2f-46d7-99a4-7c58ef239970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.697374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052988d3-9e2f-46d7-99a4-7c58ef239970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.706281 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3b9631-130d-439a-8752-7446e2b03bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.714162 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Volume fd437570-01df-4a93-ba53-f9a171f144d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd437570-01df-4a93-ba53-f9a171f144d1', 'volume_size': 1} Nov 27 21:04:15.716844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] creating volume 'volume-fd437570-01df-4a93-ba53-f9a171f144d1' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:15.718205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:15.865389 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:15.866010 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:15.869455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3b9631-130d-439a-8752-7446e2b03bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd437570-01df-4a93-ba53-f9a171f144d1', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.872234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f4c4ac-893c-4827-9b23-9d6ec79483a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:15.888054 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Volume volume-fd437570-01df-4a93-ba53-f9a171f144d1 (fd437570-01df-4a93-ba53-f9a171f144d1): created successfully Nov 27 21:04:15.891805 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f4c4ac-893c-4827-9b23-9d6ec79483a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:15.894850 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (4c876c8f-5a31-40f6-92f6-f6f37adcab69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:15.920103 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b9f0fcf7-7329-451b-9d55-201f147730c3 tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:16.837553 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-fd437570-01df-4a93-ba53-f9a171f144d1-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:16.941758 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:17.045167 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:17.045437 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Volume volume-fd437570-01df-4a93-ba53-f9a171f144d1 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:17.059483 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-fd437570-01df-4a93-ba53-f9a171f144d1 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:17.482291 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Created reservations ['302083ee-e835-49b6-8bfb-5e123be5472a', 'a6dac139-b65b-475a-9102-f89f9f4e47d1', '02e8b2fc-2a03-4485-a31a-228d01cfb185', '6c715bdd-8cf9-40a9-ac11-0b8eeacad0a9'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:17.602698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:17.688241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:17.796365 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:17.802757 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:17.828013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1ad460fe-5501-492e-81eb-2284a973ac85 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-fd437570-01df-4a93-ba53-f9a171f144d1-delete_volume'" released by "delete_volume" :: held 0.991s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:18.114292 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-11874805-9715-4023-ba0e-0d90a2d4e4b3-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:18.177272 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:18.295074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:18.307406 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-11874805-9715-4023-ba0e-0d90a2d4e4b3 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:18.676614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:04:18.703987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Volume volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:18.704844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] deleting parent snapshot volume-11874805-9715-4023-ba0e-0d90a2d4e4b3.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:04:19.034904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Created reservations ['15b9e9ce-b8e1-4d52-a2c9-fcc1ee89222e', 'dad5f4df-71fd-44fb-b66e-addd8e564b74', 'f6fc304e-8bd8-43a0-8e94-9a96682486f2', '6a352059-6640-4d1f-ac96-8c4e9bb874ca'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:19.171406 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:19.318799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:19.416646 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:19.421272 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:19.441599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9dbb1490-7442-4d0e-b931-38cbcb131814 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-11874805-9715-4023-ba0e-0d90a2d4e4b3-delete_volume'" released by "delete_volume" :: held 1.327s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:19.617142 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a018052c-2e97-4fcf-87fb-394fbb0ff5ad tempest-GroupsV314Test-1280380510 None] Group tempest-GroupsV314Test-Group-1203235525: creating Nov 27 21:04:19.649080 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a018052c-2e97-4fcf-87fb-394fbb0ff5ad tempest-GroupsV314Test-1280380510 None] Group tempest-GroupsV314Test-Group-1203235525: created successfully Nov 27 21:04:19.660318 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a018052c-2e97-4fcf-87fb-394fbb0ff5ad tempest-GroupsV314Test-1280380510 None] Create group completed successfully. Nov 27 21:04:20.397158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:20.408575 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:20.409145 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:20.439329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (40f43402-3dd9-4446-bb4d-6d65113344ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:20.443485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376e4fb-f2ed-4d58-bee5-4deb432edd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:20.452792 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:20.475069 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376e4fb-f2ed-4d58-bee5-4deb432edd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1067976554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ddc49b38-f170-4b68-8051-d14ca2dc5328,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:20Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:20.480237 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fa3c9c-3a3e-4f1e-bf06-c7acb56267e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:20.482907 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fa3c9c-3a3e-4f1e-bf06-c7acb56267e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:20.486250 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028a389c-ab12-46e2-a857-1aab2f909e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:20.609198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028a389c-ab12-46e2-a857-1aab2f909e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddc49b38-f170-4b68-8051-d14ca2dc5328', 'volume_name': 'volume-ddc49b38-f170-4b68-8051-d14ca2dc5328', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:20.613321 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55416692-63a8-4e3f-bc4e-12783ba55a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:20.616065 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55416692-63a8-4e3f-bc4e-12783ba55a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:20.620554 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45b8723-6a4d-4da8-94a7-08c671e09a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:20.626541 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Volume ddc49b38-f170-4b68-8051-d14ca2dc5328: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddc49b38-f170-4b68-8051-d14ca2dc5328', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:04:20.627186 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Cloning ddc49b38-f170-4b68-8051-d14ca2dc5328 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:04:20.667615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.036s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:20.708593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 4, 20, 675877)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:04:20.711579 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:04:20.712023 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:04:20.728104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.060s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:20.729056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:04:20.764661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 4, 20, 758815)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:04:20.765395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:04:20.765958 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:04:20.791769 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:20.951184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] creating snapshot='volume-ddc49b38-f170-4b68-8051-d14ca2dc5328.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:04:21.996866 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-ddc49b38-f170-4b68-8051-d14ca2dc5328.clone_snap' to 'volume-ddc49b38-f170-4b68-8051-d14ca2dc5328' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:04:22.087396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:22.091435 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:22.091993 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:22.166655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Flow 'volume_create_manager' (9ac76a19-aac9-44b9-9ae5-be94b4b6e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:22.176808 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec651ad5-845f-47b4-828a-dfe50eb9f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.199073 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:22.225394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec651ad5-845f-47b4-828a-dfe50eb9f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1232773690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5964b234-0ade-4cfc-80d3-b2e7d71674d0,host='ncdv-master-1@ceph#ceph',id=f4ac1971-0230-424a-aab4-c27d1dbafa8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba58e4860f44491f950630661492e3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:22Z,use_quota=True,user_id='fc32e09e8f344a3ba885fbc068c25d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9959d39f-adf2-43f2-b984-1ffc96003401),volume_type_id=9959d39f-adf2-43f2-b984-1ffc96003401)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.243837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78d7cd-a2b4-4dae-86dc-ddce74bbf41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.243837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78d7cd-a2b4-4dae-86dc-ddce74bbf41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.243837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae4247a-3e8d-49dc-820a-400206fc12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.246563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae4247a-3e8d-49dc-820a-400206fc12af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ac1971-0230-424a-aab4-c27d1dbafa8d', 'volume_name': 'volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.248938 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd7b9c8-b969-4645-b542-40618a12639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.251056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd7b9c8-b969-4645-b542-40618a12639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.253275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959cf82-d75f-472b-b72a-9a44a7a647b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.341703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:22.343719 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:22.344508 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:22.381774 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:04:22.382464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Marking volume ddc49b38-f170-4b68-8051-d14ca2dc5328 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:04:22.436135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to ddc49b38-f170-4b68-8051-d14ca2dc5328. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:04:22.437063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Creating volume glance metadata for volume ddc49b38-f170-4b68-8051-d14ca2dc5328 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:04:22.488637 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Volume f4ac1971-0230-424a-aab4-c27d1dbafa8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d', 'volume_size': 1} Nov 27 21:04:22.489294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] creating volume 'volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:22.490962 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:22.546656 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45b8723-6a4d-4da8-94a7-08c671e09a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc49b38-f170-4b68-8051-d14ca2dc5328', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.550432 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e745cc7-5032-4480-9104-15ae26e0c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.570200 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Volume volume-ddc49b38-f170-4b68-8051-d14ca2dc5328 (ddc49b38-f170-4b68-8051-d14ca2dc5328): created successfully Nov 27 21:04:22.572136 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e745cc7-5032-4480-9104-15ae26e0c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.576703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (40f43402-3dd9-4446-bb4d-6d65113344ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:22.597180 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cf22af70-9302-4352-9132-7d72a1a825d1 tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:22.624751 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:22.625148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:22.628231 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9959cf82-d75f-472b-b72a-9a44a7a647b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.632640 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e43a4be-9049-4066-a3a2-c3de7655e6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:22.656306 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Volume volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d (f4ac1971-0230-424a-aab4-c27d1dbafa8d): created successfully Nov 27 21:04:22.659634 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e43a4be-9049-4066-a3a2-c3de7655e6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:22.686734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Flow 'volume_create_manager' (9ac76a19-aac9-44b9-9ae5-be94b4b6e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:22.711503 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d41a6705-315b-421a-952e-e44fb609689c tempest-GroupsV314Test-1280380510 None] Created volume successfully. Nov 27 21:04:25.094192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:25.108642 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:25.109102 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:25.170656 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (e204d489-5d37-43a6-8d75-a2ecb6cf808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:25.183205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cef078-c254-4172-b3aa-cb1f2b557c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:25.221384 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:25.333804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cef078-c254-4172-b3aa-cb1f2b557c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2089076323',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d6a72020-cf00-4e31-8cb6-445d5c836a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b22e03c6d74976a86529d4cf57fb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:25Z,use_quota=True,user_id='9fe049055ac04c0b909e9db231f692ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:25.341321 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe83498-9318-403a-a032-fbe46ea71b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:25.355802 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe83498-9318-403a-a032-fbe46ea71b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:25.361672 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268cf692-642c-4a86-b5e9-dc4d65d9977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:25.372088 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268cf692-642c-4a86-b5e9-dc4d65d9977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a72020-cf00-4e31-8cb6-445d5c836a72', 'volume_name': 'volume-d6a72020-cf00-4e31-8cb6-445d5c836a72', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:25.377235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9412c03-4b00-493a-a74e-85f5cd84f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:25.388495 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9412c03-4b00-493a-a74e-85f5cd84f89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:25.393809 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423cb29d-5923-433e-9780-496de4cfc8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:25.394640 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Volume d6a72020-cf00-4e31-8cb6-445d5c836a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a72020-cf00-4e31-8cb6-445d5c836a72', 'volume_size': 1} Nov 27 21:04:25.398417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] creating volume 'volume-d6a72020-cf00-4e31-8cb6-445d5c836a72' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:25.399537 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:25.541982 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:25.681306 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] creating snapshot='volume-8c977040-49cd-4e97-b34e-5cbc154aeb29.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:04:26.214714 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] cloning 'volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d@volume-8c977040-49cd-4e97-b34e-5cbc154aeb29.clone_snap' to 'volume-8c977040-49cd-4e97-b34e-5cbc154aeb29' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:04:26.227029 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:26.228069 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:26.231582 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423cb29d-5923-433e-9780-496de4cfc8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a72020-cf00-4e31-8cb6-445d5c836a72', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:26.235834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5b36b-754e-401a-83fb-e5578046c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:26.248767 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Volume volume-d6a72020-cf00-4e31-8cb6-445d5c836a72 (d6a72020-cf00-4e31-8cb6-445d5c836a72): created successfully Nov 27 21:04:26.250874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5b36b-754e-401a-83fb-e5578046c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:26.255359 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Flow 'volume_create_manager' (e204d489-5d37-43a6-8d75-a2ecb6cf808f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:26.264787 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-71df3bb4-b000-4a79-81e2-6d19492e4c62 tempest-VolumesGetTest-191011935 None] Created volume successfully. Nov 27 21:04:26.320475 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] Volume volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:26.327823 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:26.328205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:26.345076 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:04:26.399765 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5fc2f43a-e416-4cfc-9ab0-8b475c4a3526 tempest-GroupsV314Test-1280380510 None] Create group from source-group-5964b234-0ade-4cfc-80d3-b2e7d71674d0 completed successfully. Nov 27 21:04:26.891998 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:26.970888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:26.978874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] deleting rbd volume volume-8c977040-49cd-4e97-b34e-5cbc154aeb29 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:27.232363 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:04:27.258593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Volume volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:27.259487 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] deleting parent snapshot volume-8c977040-49cd-4e97-b34e-5cbc154aeb29.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:04:28.283085 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Lock "b'cinder-d6a72020-cf00-4e31-8cb6-445d5c836a72-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:28.327123 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Created reservations ['30061b81-6511-4fb5-90ac-e7fc109fd6f2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:28.333225 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:28.390316 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:28.391000 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Volume volume-d6a72020-cf00-4e31-8cb6-445d5c836a72 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:28.396417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-d6a72020-cf00-4e31-8cb6-445d5c836a72 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:28.415212 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1647346238 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1647346238, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:04:28.416322 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1647346238 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1647346238, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:04:28.434078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Created reservations ['43ee4f45-86f0-43f5-bbb5-622c1beee202', '1ba4ffbb-53fc-4ac1-bcca-b8c26f981e46', '5299d7ac-e966-479a-a97f-e9ec508b3a25', 'ab00d2a1-8b86-4817-aba8-b88674813888'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:28.531486 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:28.570779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:28.598510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:28.603043 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dbe7e778-c938-4805-8394-7f26e45ee82b tempest-GroupsV314Test-1280380510 None] Delete group completed successfully. Nov 27 21:04:28.666326 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Created reservations ['f1550f46-b532-4fc9-92e3-9bed31e267ba', 'a0c780db-2fee-45bc-b4f3-6616ad7b10f0', '2c9ad804-44f3-4ff6-9439-ceafb8cccb90', '79c9cc20-aa86-43b9-bba4-7832fade82a4'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:28.707585 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:28.730219 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:28.755534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:28.761735 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:28.773715 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0f473576-7eca-4947-9e26-deaf19c994bb tempest-VolumesGetTest-191011935 None] Lock "b'cinder-d6a72020-cf00-4e31-8cb6-445d5c836a72-delete_volume'" released by "delete_volume" :: held 0.491s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:29.520700 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] Lock "b'cinder-ddc49b38-f170-4b68-8051-d14ca2dc5328-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:29.524468 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:29.586358 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:29.587285 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] Volume volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:29.597195 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] deleting rbd volume volume-f4ac1971-0230-424a-aab4-c27d1dbafa8d {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:29.635908 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:29.735891 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:29.746654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-ddc49b38-f170-4b68-8051-d14ca2dc5328 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:29.878383 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] Created reservations ['2feb2061-e5a9-4d5a-8c1a-1fb891341d9f'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:29.914332 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] Created reservations ['4cd81d67-0818-4a43-9f78-21ec45f8a958', 'c8a75a64-1638-445c-b687-fec92bca0a27', 'e8d1635e-1a50-4f30-b9c5-28de352fe959', '6f73b598-a881-4596-97d9-f3be073a666a'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:30.006031 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:04:30.046880 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] deleting parent snapshot volume-ddc49b38-f170-4b68-8051-d14ca2dc5328.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:04:30.311149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:30.344221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:30.404556 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:30.410516 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e15e74fe-e5e8-42e2-a325-0fec735fe5ef tempest-GroupsV314Test-1280380510 None] Delete group completed successfully. Nov 27 21:04:30.442135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] Created reservations ['f6b062cd-62f7-4d29-be16-243ea5c742b6', 'e8306bb0-3d3c-4585-a499-b985440ca96d', '7eca6d26-6aa1-4c52-9a06-ea080f4c7139', '5661ee7f-3e5c-4d06-8a3f-1fdfd9d843eb'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:30.503703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:30.578644 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:30.640839 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:30.644941 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:30.666160 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7c57ad52-3c95-4249-8098-dc57902d8c0e tempest-VolumesGetTest-191011935 None] Lock "b'cinder-ddc49b38-f170-4b68-8051-d14ca2dc5328-delete_volume'" released by "delete_volume" :: held 1.145s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:30.845059 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:30.903997 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:30.971615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:30.972359 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Volume volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:30.985187 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] deleting rbd volume volume-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:31.350105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Created reservations ['a7ed4cb5-1ad0-4ca2-a7ce-e2fa0a034a8e', '99541947-9125-4cd7-8693-b76de2302a35', '78acc9a3-a9cf-4460-9bc8-4ebf01fe356e', '19df5405-675b-4d1b-b867-f142bb1c66de'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:31.408697 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:31.477966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:31.553966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:31.577708 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Deleted volume successfully. Nov 27 21:04:31.595580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cdef17f1-0793-4180-bb1c-9ff6a4505a97 tempest-VolumesGetTest-191011935 None] Lock "b'cinder-d82050bf-d0e7-41e3-a444-b1cd12ac2eb9-delete_volume'" released by "delete_volume" :: held 0.752s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:36.720170 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4a076177-4323-41c6-be27-2d74982dc546 tempest-GroupsV320Test-350659720 None] Group tempest-GroupsV320Test-Group-1143547812: creating Nov 27 21:04:36.755311 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4a076177-4323-41c6-be27-2d74982dc546 tempest-GroupsV320Test-350659720 None] Group tempest-GroupsV320Test-Group-1143547812: created successfully Nov 27 21:04:36.770368 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4a076177-4323-41c6-be27-2d74982dc546 tempest-GroupsV320Test-350659720 None] Create group completed successfully. Nov 27 21:04:38.428347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-fc6e5a09-1917-4c6f-917e-40ad8ba5dd52 tempest-GroupsV320Test-350659720 None] Created reservations ['79e82efe-f05f-4717-8f0c-fb876ffa3b2e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:38.504220 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc6e5a09-1917-4c6f-917e-40ad8ba5dd52 tempest-GroupsV320Test-350659720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:38.567394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc6e5a09-1917-4c6f-917e-40ad8ba5dd52 tempest-GroupsV320Test-350659720 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:38.665954 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-fc6e5a09-1917-4c6f-917e-40ad8ba5dd52 tempest-GroupsV320Test-350659720 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:38.671197 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fc6e5a09-1917-4c6f-917e-40ad8ba5dd52 tempest-GroupsV320Test-350659720 None] Delete group completed successfully. Nov 27 21:04:46.957059 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:04:46.969730 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:04:46.970584 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:04:46.994933 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Flow 'volume_create_manager' (bf3e0a37-b20c-4fb7-baa1-50a540b3343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:47.003889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4174d948-6c97-4082-ba2e-2c99de2fad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.014505 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:04:47.032291 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4174d948-6c97-4082-ba2e-2c99de2fad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-956640485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec97a830-5b99-465f-880a-1288fcd71ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da887555f8644469f2c0d5986a8423a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:04:47Z,use_quota=True,user_id='378870e5a56b433eb4ffbd5cd6ed8bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.036609 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0ba79-b4db-4112-941c-4b6e0704f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.043047 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0ba79-b4db-4112-941c-4b6e0704f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.046890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52f0d7-621d-443e-99a3-04e2c0d48218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.056259 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52f0d7-621d-443e-99a3-04e2c0d48218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec97a830-5b99-465f-880a-1288fcd71ff3', 'volume_name': 'volume-ec97a830-5b99-465f-880a-1288fcd71ff3', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.067653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffecbf0-dbdc-4303-868e-354b32622b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.070118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffecbf0-dbdc-4303-868e-354b32622b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.084935 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f981e5b-570e-41f2-b13d-fa1dd8a66fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.085779 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Volume ec97a830-5b99-465f-880a-1288fcd71ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec97a830-5b99-465f-880a-1288fcd71ff3', 'volume_size': 1} Nov 27 21:04:47.086854 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] creating volume 'volume-ec97a830-5b99-465f-880a-1288fcd71ff3' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:04:47.088585 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:47.264977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:04:47.266308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:04:47.270791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f981e5b-570e-41f2-b13d-fa1dd8a66fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec97a830-5b99-465f-880a-1288fcd71ff3', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.274527 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd40a81e-3ec6-4d0c-a6a0-934785dd9df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:04:47.299094 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Volume volume-ec97a830-5b99-465f-880a-1288fcd71ff3 (ec97a830-5b99-465f-880a-1288fcd71ff3): created successfully Nov 27 21:04:47.306416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd40a81e-3ec6-4d0c-a6a0-934785dd9df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:04:47.320662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Flow 'volume_create_manager' (bf3e0a37-b20c-4fb7-baa1-50a540b3343a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:04:47.340667 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-312984c3-2d78-493f-a4b6-90b015576364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Created volume successfully. Nov 27 21:04:48.457026 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c1513f6-968c-42c2-b2a5-a49c0c7a4154 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:49.389636 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7c1513f6-968c-42c2-b2a5-a49c0c7a4154 tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Create snapshot completed successfully Nov 27 21:04:50.052177 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-b281637f-01f7-41c6-8c0c-96f8a7ca68ff tempest-TaggedBootDevicesTest_v242-2000740141 None] Terminate volume connection completed successfully. Nov 27 21:04:50.055502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-b281637f-01f7-41c6-8c0c-96f8a7ca68ff tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleting attachment 9dd26b34-5e3d-413a-9b02-1b457dfbf005. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:04:50.374935 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-25a6151c-07cd-41bc-b61a-fbc4378a1671 tempest-TaggedBootDevicesTest_v242-2000740141 None] Terminate volume connection completed successfully. Nov 27 21:04:50.379479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-25a6151c-07cd-41bc-b61a-fbc4378a1671 tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleting attachment b85d9744-6734-4268-b199-2f6ffdec68fc. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:04:50.504931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b840bf7f-d5e8-430c-bf97-935825bc482d tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Lock "b'cinder-4c509c11-bb28-4fbd-b9be-2bda2fe4ac14-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:50.510284 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b840bf7f-d5e8-430c-bf97-935825bc482d tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:50.710384 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-ca10e5da-5eb7-4d5b-8681-4110c7da2c2e tempest-TaggedBootDevicesTest_v242-2000740141 None] Terminate volume connection completed successfully. Nov 27 21:04:50.712356 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-6fde4d83-060e-4555-b387-de839e9c9d48 req-ca10e5da-5eb7-4d5b-8681-4110c7da2c2e tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleting attachment e8dd1864-1b9a-4e40-8a99-d3662f5a4d6e. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:04:51.492816 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b840bf7f-d5e8-430c-bf97-935825bc482d tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Created reservations ['8c275dd4-3e2f-4fa3-850d-be21df98e183', '9d5d4c55-ddd0-4695-91f1-400529e0e02e', '1f876669-dae5-4b26-b088-81ce03f45c96', 'd34fbb4a-b866-4bde-9415-c7b5aeb5bfdd'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:51.569817 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b840bf7f-d5e8-430c-bf97-935825bc482d tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Delete snapshot completed successfully. Nov 27 21:04:51.576959 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b840bf7f-d5e8-430c-bf97-935825bc482d tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Lock "b'cinder-4c509c11-bb28-4fbd-b9be-2bda2fe4ac14-delete_snapshot'" released by "delete_snapshot" :: held 1.074s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:51.713512 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Lock "b'cinder-ec97a830-5b99-465f-880a-1288fcd71ff3-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:04:51.807086 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:51.879913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:04:51.880563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Volume volume-ec97a830-5b99-465f-880a-1288fcd71ff3 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:04:51.887849 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] deleting rbd volume volume-ec97a830-5b99-465f-880a-1288fcd71ff3 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:04:52.385770 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Created reservations ['01357036-79c9-43ab-9fbb-61c1c18ffe2d', '8c9b1fa8-aa37-4da7-a804-5743e774d4a7', 'd85d40a3-6cf6-4c70-9e77-8df55dfe724a', '78a0ec44-6ff7-43e0-ae32-ffd1107ca409'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:04:52.477960 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:52.536666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:52.618291 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:04:52.623628 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Deleted volume successfully. Nov 27 21:04:52.638661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1f02a63a-0b79-4551-aa0d-c171a6b20a1b tempest-VolumeSnapshotQuotasNegativeTestJSON-1513772074 None] Lock "b'cinder-ec97a830-5b99-465f-880a-1288fcd71ff3-delete_volume'" released by "delete_volume" :: held 0.925s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:04:57.899562 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:04:57.900234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:57.989768 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:04:58.094412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:02.333624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:05:02.352189 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:05:02.352801 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:05:02.438302 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Flow 'volume_create_manager' (e6b2ab0b-85ef-4650-867b-e68046ed8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:02.449509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62717372-b64a-4825-99eb-be7d55be7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.463513 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:05:02.544366 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62717372-b64a-4825-99eb-be7d55be7285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-660685578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=49d669c5-1ca0-4295-972c-2649b8e575cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519faaaead914dc8b55c6a4251bb8c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:05:02Z,use_quota=True,user_id='7fd08bde9a52432abf2e0646b2fdf65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(400d2dd3-08ea-406c-855d-ed3cf34aff19),volume_type_id=400d2dd3-08ea-406c-855d-ed3cf34aff19)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.562068 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855eaab2-f383-462a-81e4-60a1e9895d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.571706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855eaab2-f383-462a-81e4-60a1e9895d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.574168 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccc3f69-8c56-42d7-9bc2-d4780840075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.576628 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccc3f69-8c56-42d7-9bc2-d4780840075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d669c5-1ca0-4295-972c-2649b8e575cb', 'volume_name': 'volume-49d669c5-1ca0-4295-972c-2649b8e575cb', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.587013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956d4e51-0a1e-4057-bf78-5e935c368a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.597614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956d4e51-0a1e-4057-bf78-5e935c368a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.604622 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf8157f-74dc-47f7-b284-8cb2ae134241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.606883 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Volume 49d669c5-1ca0-4295-972c-2649b8e575cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d669c5-1ca0-4295-972c-2649b8e575cb', 'volume_size': 1} Nov 27 21:05:02.608195 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] creating volume 'volume-49d669c5-1ca0-4295-972c-2649b8e575cb' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:05:02.618045 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:02.775024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:05:02.776805 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:05:02.784482 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf8157f-74dc-47f7-b284-8cb2ae134241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d669c5-1ca0-4295-972c-2649b8e575cb', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.786951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21cc852-1d62-4fa3-a934-34f5f51622de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:02.806880 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Volume volume-49d669c5-1ca0-4295-972c-2649b8e575cb (49d669c5-1ca0-4295-972c-2649b8e575cb): created successfully Nov 27 21:05:02.810538 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21cc852-1d62-4fa3-a934-34f5f51622de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:02.837229 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Flow 'volume_create_manager' (e6b2ab0b-85ef-4650-867b-e68046ed8da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:02.866924 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f444cabf-cda6-43fd-a251-5407ae02401e tempest-VolumeTypesAccessTest-64670101 None] Created volume successfully. Nov 27 21:05:03.287748 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Lock "b'cinder-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:03.395806 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:03.492523 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:03.492957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Volume volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:03.500707 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] deleting rbd volume volume-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:03.997949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Created reservations ['4931c5f0-9ca8-484a-a1e0-51b5d0e8c78a', '30342c84-7ce7-46b7-84e0-b757c0290db9', 'fae58db0-e6c6-41ee-8617-d75b27489a3d', '384688cc-9e7c-46ea-92f1-e8c86f0f5711'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:04.020565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Lock "b'cinder-49d669c5-1ca0-4295-972c-2649b8e575cb-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:04.205046 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:04.292158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:04.292934 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Volume volume-49d669c5-1ca0-4295-972c-2649b8e575cb is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:04.307272 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] deleting rbd volume volume-49d669c5-1ca0-4295-972c-2649b8e575cb {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:04.311162 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-9acdff48-832d-43c1-a2c9-2c6d43a6f9da-delete_volume'" acquired by "delete_volume" :: waited 0.151s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:04.372696 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:04.444843 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:04.513113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:04.521325 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Deleted volume successfully. Nov 27 21:05:04.531947 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:04.594406 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:04.594912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:04.604032 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] deleting rbd volume volume-9acdff48-832d-43c1-a2c9-2c6d43a6f9da {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:04.623925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-bb4ac509-25f8-44b9-a96b-a76c19a570ce tempest-ServersNegativeTestJSON-5863557 None] Lock "b'cinder-80d0ddd8-7411-489b-8c3c-7a9be3ba1b98-delete_volume'" released by "delete_volume" :: held 1.336s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:04.628567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Lock "b'cinder-80a5bb1b-01cc-4cd5-8cc8-2614826723a2-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:04.689478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:04.799111 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:04.801535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Volume volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:04.821680 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] deleting rbd volume volume-80a5bb1b-01cc-4cd5-8cc8-2614826723a2 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:04.839801 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-683597747 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-683597747, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:05:04.840702 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-683597747 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-683597747, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:05:04.866249 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Created reservations ['25813442-3b92-4b91-a0ec-ae8e37fb1352', '111f97e1-009b-4007-a10f-0276c3b8c8f8', '775e9ec9-4ceb-4484-9ac2-75bc2950d225', 'b15cec7b-44af-4e65-86b4-db24a3b86844'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:04.974009 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:05.074091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:05.153166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:05.196451 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Deleted volume successfully. Nov 27 21:05:05.282163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f003f9f1-9696-4156-93f6-2bd241f47020 tempest-VolumeTypesAccessTest-64670101 None] Lock "b'cinder-49d669c5-1ca0-4295-972c-2649b8e575cb-delete_volume'" released by "delete_volume" :: held 1.251s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:05.414307 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Created reservations ['9b27f23b-c0ca-4040-b06c-013da6f1834d', '259d156d-ddf5-4aea-91b3-403ca254df27', '12bff259-1207-4e14-be57-2caac0724afd', '8495ee8e-44a3-47bd-ad43-b4b963cbbbfa'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:05.524044 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Created reservations ['39b3dee5-eed5-4abd-9320-816a16e63232', '62b75b70-f045-4fc8-9f78-27c2534938ae', '49bd4d0d-05ff-4b32-b6c8-c30432e064ea', 'c1a1f009-9406-4628-8226-f44e461c7c01'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:05.549011 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:05.655147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:05.747747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:05.756252 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleted volume successfully. Nov 27 21:05:05.781873 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d5b60809-e850-4b36-8452-dbab9261f618 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-9acdff48-832d-43c1-a2c9-2c6d43a6f9da-delete_volume'" released by "delete_volume" :: held 1.470s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:05.840122 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:05.915847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:06.017492 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:06.023610 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Deleted volume successfully. Nov 27 21:05:06.050449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7b4c8ad2-81cc-4582-9d75-dace7a8adc8a tempest-ServersNegativeTestJSON-5863557 None] Lock "b'cinder-80a5bb1b-01cc-4cd5-8cc8-2614826723a2-delete_volume'" released by "delete_volume" :: held 1.421s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:06.501874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-7b8f6b91-0f5d-43af-b670-f5ec500355d4-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:06.561420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:06.663324 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:06.663852 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Volume volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:06.678299 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] deleting rbd volume volume-7b8f6b91-0f5d-43af-b670-f5ec500355d4 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:07.253220 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Created reservations ['40acfcf2-fdb9-4c53-87ff-da41edbcd0d2', 'c8eba29d-f2d1-43f2-88cc-5aa4b12359f1', 'e82c3fb7-5704-4a9a-bcde-2630609b56c1', '20f55eb3-824a-4c32-82e6-2e4dccfee0d6'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:07.386620 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:07.549940 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:07.669429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:07.673843 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleted volume successfully. Nov 27 21:05:07.696695 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-47d89143-03c3-425d-ad93-1a3327d191b6 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-7b8f6b91-0f5d-43af-b670-f5ec500355d4-delete_volume'" released by "delete_volume" :: held 1.194s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:07.779545 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-021a76d9-22a2-4682-b594-1eb66d6d2882-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:07.883559 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:08.061142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:08.076845 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] deleting rbd volume volume-021a76d9-22a2-4682-b594-1eb66d6d2882 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:08.627696 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:05:08.681762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] deleting parent snapshot volume-021a76d9-22a2-4682-b594-1eb66d6d2882.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:05:09.484702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] Created reservations ['ef212a56-6cf6-4c06-8a96-cc58e412126c', '9ae695b2-a9a6-4c03-9288-3a3a9c1c955a', 'b0015527-ed8a-422d-bfb8-0fea099f485d', 'b3703dfc-f612-4bd8-8231-bca6d6132dfe'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:09.597912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:09.669848 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:09.738396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:09.743076 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] Deleted volume successfully. Nov 27 21:05:09.770563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ebe4bf51-39a4-414d-b496-c7aad8ad2341 tempest-TaggedBootDevicesTest_v242-2000740141 None] Lock "b'cinder-021a76d9-22a2-4682-b594-1eb66d6d2882-delete_volume'" released by "delete_volume" :: held 1.991s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:14.715952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:05:14.724698 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:05:14.724698 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:05:14.760420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Flow 'volume_create_manager' (9dfdafd6-a08b-4df7-a7aa-f3e0439b0373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:14.763288 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07795a1b-902a-413d-9c87-3989eb9aebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:14.793419 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:05:14.832652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07795a1b-902a-413d-9c87-3989eb9aebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1468874726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=682f5279-e937-4c62-9912-937e9c8dfc09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8c6529d50a4da58d691684a58f3787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:05:15Z,use_quota=True,user_id='610a935385384f64b6ed518478019711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:14.853299 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ecd2bb-33d5-4fb2-81cb-715bed38983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:14.855581 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ecd2bb-33d5-4fb2-81cb-715bed38983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:14.861059 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5408b1e3-fcab-4156-9b81-bfde8f04426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:15.007212 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5408b1e3-fcab-4156-9b81-bfde8f04426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '682f5279-e937-4c62-9912-937e9c8dfc09', 'volume_name': 'volume-682f5279-e937-4c62-9912-937e9c8dfc09', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:15.009955 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cd8590-ea8d-4332-9aab-02f3db30b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:15.012313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cd8590-ea8d-4332-9aab-02f3db30b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:15.014755 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79ce09b-27b3-4c93-90e1-65491b982565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:15.015795 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Volume 682f5279-e937-4c62-9912-937e9c8dfc09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-682f5279-e937-4c62-9912-937e9c8dfc09', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:05:15.016608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Cloning 682f5279-e937-4c62-9912-937e9c8dfc09 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:05:15.032352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:15.058104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 5, 15, 36722)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:05:15.058541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:05:15.059089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:05:15.064731 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:15.066240 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:05:15.075536 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 5, 15, 72347)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:05:15.076323 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:05:15.077563 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:05:15.091322 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:15.206753 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] creating snapshot='volume-682f5279-e937-4c62-9912-937e9c8dfc09.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:05:15.581099 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-682f5279-e937-4c62-9912-937e9c8dfc09.clone_snap' to 'volume-682f5279-e937-4c62-9912-937e9c8dfc09' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:05:15.808034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:15.809123 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:05:15.809530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:05:15.841335 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:05:15.842573 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Marking volume 682f5279-e937-4c62-9912-937e9c8dfc09 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:05:15.854762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 682f5279-e937-4c62-9912-937e9c8dfc09. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:05:15.855660 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Creating volume glance metadata for volume 682f5279-e937-4c62-9912-937e9c8dfc09 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:05:15.952918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79ce09b-27b3-4c93-90e1-65491b982565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682f5279-e937-4c62-9912-937e9c8dfc09', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:15.956496 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f876f40e-b7b5-470e-a21c-734dd0f888a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:15.988987 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Volume volume-682f5279-e937-4c62-9912-937e9c8dfc09 (682f5279-e937-4c62-9912-937e9c8dfc09): created successfully Nov 27 21:05:16.011204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f876f40e-b7b5-470e-a21c-734dd0f888a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:16.014493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Flow 'volume_create_manager' (9dfdafd6-a08b-4df7-a7aa-f3e0439b0373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:16.041935 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-289ec380-f24c-4441-aacd-7bb6acad5f5c tempest-VolumesImageMetadata-214311546 None] Created volume successfully. Nov 27 21:05:17.412701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] Lock "b'cinder-682f5279-e937-4c62-9912-937e9c8dfc09-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:17.531234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:17.665429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:17.680008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] deleting rbd volume volume-682f5279-e937-4c62-9912-937e9c8dfc09 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:18.120532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:05:18.167208 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] deleting parent snapshot volume-682f5279-e937-4c62-9912-937e9c8dfc09.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:05:19.361403 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] Created reservations ['f234ccd2-9c3b-4951-8a48-6531837f8af5', '9e2a930a-08e6-453d-83cd-ae5f1ec4b41f', 'd89b9130-0fba-4b9b-b454-e67cb2058d3b', '524b5149-22ef-4732-9430-631b0b59b8a7'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:19.445448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:19.511412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:19.572129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:19.577123 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] Deleted volume successfully. Nov 27 21:05:19.597205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fc9009d6-ae46-41ca-b8e3-ec1a334b753c tempest-VolumesImageMetadata-214311546 None] Lock "b'cinder-682f5279-e937-4c62-9912-937e9c8dfc09-delete_volume'" released by "delete_volume" :: held 2.184s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:26.003473 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:05:26.009517 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:05:26.010687 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:05:26.027710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Flow 'volume_create_manager' (d85ada44-9cbc-4ff6-855c-1c7e5200447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:26.031634 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff07604-4be7-4a71-a07d-6eada84dd391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.039527 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:05:26.056320 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff07604-4be7-4a71-a07d-6eada84dd391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-666876468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31e4d18e-27d2-4343-b1c6-57baae979bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bdcf37a45c4567bdcafd69eddf81a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:05:26Z,use_quota=True,user_id='f850a01aa7a642d7b5f3e861fa2eec92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.059910 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7b7e65-fa34-4e37-a99f-806395c9288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.067144 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7b7e65-fa34-4e37-a99f-806395c9288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.071823 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eeb9af-ca66-459a-84f5-9b847dc5ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.074720 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eeb9af-ca66-459a-84f5-9b847dc5ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e4d18e-27d2-4343-b1c6-57baae979bdb', 'volume_name': 'volume-31e4d18e-27d2-4343-b1c6-57baae979bdb', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.078057 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac06fe1-b131-4aa0-aba1-b29ea7156a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.087303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac06fe1-b131-4aa0-aba1-b29ea7156a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.091479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddf375-6ef6-4c74-a7eb-2fcdae0d984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.092810 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Volume 31e4d18e-27d2-4343-b1c6-57baae979bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e4d18e-27d2-4343-b1c6-57baae979bdb', 'volume_size': 1} Nov 27 21:05:26.093405 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] creating volume 'volume-31e4d18e-27d2-4343-b1c6-57baae979bdb' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:05:26.094698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:26.253779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:05:26.254097 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:05:26.258649 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddf375-6ef6-4c74-a7eb-2fcdae0d984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e4d18e-27d2-4343-b1c6-57baae979bdb', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.262270 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270c6f54-9341-4ce2-83b3-5ef95c5d548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:26.281645 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Volume volume-31e4d18e-27d2-4343-b1c6-57baae979bdb (31e4d18e-27d2-4343-b1c6-57baae979bdb): created successfully Nov 27 21:05:26.290493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270c6f54-9341-4ce2-83b3-5ef95c5d548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:26.297424 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Flow 'volume_create_manager' (d85ada44-9cbc-4ff6-855c-1c7e5200447b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:26.315336 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0658674c-19a2-4e0a-920a-50ef3e1554b4 tempest-VolumesTransfersV355Test-1934860891 None] Created volume successfully. Nov 27 21:05:28.245809 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-12767950-122e-4a6a-a77c-e834bd768fd2 tempest-VolumesTransfersV355Test-1900507138 None] Transfer volume completed successfully. Nov 27 21:05:29.022377 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Lock "b'cinder-31e4d18e-27d2-4343-b1c6-57baae979bdb-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:29.110986 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:29.232842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:29.233566 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Volume volume-31e4d18e-27d2-4343-b1c6-57baae979bdb is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:29.247004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] deleting rbd volume volume-31e4d18e-27d2-4343-b1c6-57baae979bdb {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:29.713156 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Created reservations ['a2c92fa4-4c10-43f7-99b1-a9c334f1769c', 'ab91afb5-56ef-4141-94b6-c9ed1841b1dd', '21e5770c-7b20-49e2-9c22-6b3f0130afce', '47637ec4-ee9c-47e8-81d6-9f8f8a8aee49'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:29.775489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:29.822147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:29.878903 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:29.885215 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Deleted volume successfully. Nov 27 21:05:29.905341 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3076fad2-e029-4155-b93a-2b85925648df tempest-VolumesTransfersV355Test-1101810242 None] Lock "b'cinder-31e4d18e-27d2-4343-b1c6-57baae979bdb-delete_volume'" released by "delete_volume" :: held 0.883s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:30.829766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:05:30.833205 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:05:30.833658 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:05:30.861792 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Flow 'volume_create_manager' (aaca7459-68f8-4291-93ae-ac957d2a2e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:30.868862 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f2e998-8d5c-4e85-8a26-652df5af9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:30.888558 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:05:30.908879 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f2e998-8d5c-4e85-8a26-652df5af9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-278831692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=372efb57-1dbf-44e3-aa73-d90a8c079c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bdcf37a45c4567bdcafd69eddf81a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:05:31Z,use_quota=True,user_id='f850a01aa7a642d7b5f3e861fa2eec92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:30.923562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d4aae9-c7da-44e1-b9a0-871426157c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:30.932983 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d4aae9-c7da-44e1-b9a0-871426157c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:30.937700 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c50d4-9dfb-4546-aa31-a9c3d7f59271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:30.940161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3c50d4-9dfb-4546-aa31-a9c3d7f59271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372efb57-1dbf-44e3-aa73-d90a8c079c47', 'volume_name': 'volume-372efb57-1dbf-44e3-aa73-d90a8c079c47', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:30.947003 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add7b2f6-0856-4fcc-8638-1c211e002ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:30.949504 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add7b2f6-0856-4fcc-8638-1c211e002ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:30.951918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d1796-8571-402e-b88e-0f931f1a438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:30.952937 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Volume 372efb57-1dbf-44e3-aa73-d90a8c079c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372efb57-1dbf-44e3-aa73-d90a8c079c47', 'volume_size': 1} Nov 27 21:05:30.953501 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] creating volume 'volume-372efb57-1dbf-44e3-aa73-d90a8c079c47' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:05:30.954889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:31.056694 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:05:31.057669 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:05:31.061464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d1796-8571-402e-b88e-0f931f1a438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372efb57-1dbf-44e3-aa73-d90a8c079c47', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:31.064226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36124ef0-cf97-4963-91b5-f41e794309c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:31.087558 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Volume volume-372efb57-1dbf-44e3-aa73-d90a8c079c47 (372efb57-1dbf-44e3-aa73-d90a8c079c47): created successfully Nov 27 21:05:31.090929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36124ef0-cf97-4963-91b5-f41e794309c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:31.096241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Flow 'volume_create_manager' (aaca7459-68f8-4291-93ae-ac957d2a2e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:31.109854 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1ee3b48f-0373-4351-9bb8-944172e25e20 tempest-VolumesTransfersV355Test-1934860891 None] Created volume successfully. Nov 27 21:05:32.346710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Lock "b'cinder-372efb57-1dbf-44e3-aa73-d90a8c079c47-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:05:32.389915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:32.456902 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:05:32.458374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Volume volume-372efb57-1dbf-44e3-aa73-d90a8c079c47 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:05:32.467387 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] deleting rbd volume volume-372efb57-1dbf-44e3-aa73-d90a8c079c47 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:05:32.814871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Created reservations ['42bdaf45-a18a-44ad-9fdc-938c3d5612bc', 'a5378445-9763-46c0-83e1-b61a161e30b8', '26c59a80-6be8-4a70-b28b-b0d5937014fb', '16b16f5f-91aa-467f-a006-d659892c24ae'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:05:32.878298 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:32.933193 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:32.988078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:05:32.997963 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Deleted volume successfully. Nov 27 21:05:33.023132 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-30b42ae8-b352-41bc-a3ac-89d7f20f7102 tempest-VolumesTransfersV355Test-1101810242 None] Lock "b'cinder-372efb57-1dbf-44e3-aa73-d90a8c079c47-delete_volume'" released by "delete_volume" :: held 0.677s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:05:41.185801 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:05:41.190604 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:05:41.191207 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:05:41.208722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Flow 'volume_create_manager' (0270e1d6-ce4e-45bc-a099-48963c87141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:41.214366 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543b7424-cb19-47f6-af58-c37de720c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.221046 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:05:41.241329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543b7424-cb19-47f6-af58-c37de720c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1414933608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a847b997-af14-463d-a429-f1fae033eda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4732694cf811451b8ffabd706cd72965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:05:41Z,use_quota=True,user_id='e3dacaf685b54cf89bc9aa4e050b9a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.245395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d82a6-246d-4c5e-8d58-3fafe72b6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.248210 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d82a6-246d-4c5e-8d58-3fafe72b6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.250862 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f96b053-0d40-4cba-8360-b3e9c639fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.253574 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f96b053-0d40-4cba-8360-b3e9c639fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a847b997-af14-463d-a429-f1fae033eda3', 'volume_name': 'volume-a847b997-af14-463d-a429-f1fae033eda3', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.256639 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6b5af4-f2a7-481f-a993-42e067ffcd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.259089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6b5af4-f2a7-481f-a993-42e067ffcd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.261681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b5cd99-4b17-438c-974b-41edfe85a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.262644 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Volume a847b997-af14-463d-a429-f1fae033eda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a847b997-af14-463d-a429-f1fae033eda3', 'volume_size': 1} Nov 27 21:05:41.263198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] creating volume 'volume-a847b997-af14-463d-a429-f1fae033eda3' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:05:41.264446 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:41.380690 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:05:41.380690 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:05:41.383738 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b5cd99-4b17-438c-974b-41edfe85a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a847b997-af14-463d-a429-f1fae033eda3', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.389857 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934825d3-ebc1-4eef-9f9b-e3a126abfa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:05:41.420085 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Volume volume-a847b997-af14-463d-a429-f1fae033eda3 (a847b997-af14-463d-a429-f1fae033eda3): created successfully Nov 27 21:05:41.426384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934825d3-ebc1-4eef-9f9b-e3a126abfa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:05:41.436323 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Flow 'volume_create_manager' (0270e1d6-ce4e-45bc-a099-48963c87141e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:05:41.466764 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d52b1c84-3472-4d69-9a24-6d5cf19225d4 tempest-VolumesNegativeTest-1095374484 None] Created volume successfully. Nov 27 21:05:57.901765 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:05:57.902541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:57.954363 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:05:57.994812 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:02.654600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c25da49f-d945-4e85-aa5c-8cde13a94747 tempest-BackendsCapabilitiesAdminTestsJSON-221901017 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:496c2857-3e27-4aff-b700-6e398ccedfa6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129088) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Nov 27 21:06:02.699710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-515e3f20-e858-4fa8-9589-d083fd1a7a42 tempest-BackendsCapabilitiesAdminTestsJSON-221901017 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:496c2857-3e27-4aff-b700-6e398ccedfa6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129088) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Nov 27 21:06:07.673742 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:07.688591 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:07.692623 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:07.714070 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (0f28794e-7790-49a3-9b62-c7076ccdb123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:07.718183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb504f3-8f75-4302-8ff5-3202cf9d04ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.727458 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:07.744452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb504f3-8f75-4302-8ff5-3202cf9d04ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1405220722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a3dd7d5-d5df-461a-bf19-bedad69d73a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5ad81e73ad4ba88b6315045aef7abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:08Z,use_quota=True,user_id='3f90b25dee0148bb893dce0951c5f8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:07.748073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf164ca-ef95-42cf-9c45-b9a9d22a4270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.751369 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf164ca-ef95-42cf-9c45-b9a9d22a4270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:07.757261 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba0be0d-8156-4a8c-aae2-f0137a7941fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.763774 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba0be0d-8156-4a8c-aae2-f0137a7941fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3dd7d5-d5df-461a-bf19-bedad69d73a9', 'volume_name': 'volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:07.776855 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265ec3e2-37c3-4d02-a4f4-3e1685ecc54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.779298 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265ec3e2-37c3-4d02-a4f4-3e1685ecc54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:07.788524 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4257a586-3829-4a51-a7ef-b0e769d69c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.789648 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Volume 9a3dd7d5-d5df-461a-bf19-bedad69d73a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9', 'volume_size': 1} Nov 27 21:06:07.790296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] creating volume 'volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:07.791980 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:07.959551 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:07.960152 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:07.972451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4257a586-3829-4a51-a7ef-b0e769d69c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:07.972451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce11b7-6a32-4aac-94c4-9ddaca94f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:07.995235 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9 (9a3dd7d5-d5df-461a-bf19-bedad69d73a9): created successfully Nov 27 21:06:07.997802 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce11b7-6a32-4aac-94c4-9ddaca94f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:08.001174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (0f28794e-7790-49a3-9b62-c7076ccdb123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:08.020401 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-73f2f368-e30e-405a-9e66-2454d38a5898 tempest-VolumesListAdminTestJSON-1389470280 None] Created volume successfully. Nov 27 21:06:09.351910 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Lock "b'cinder-a847b997-af14-463d-a429-f1fae033eda3-delete_volume'" acquired by "delete_volume" :: waited 0.098s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:09.380336 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:09.397975 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:09.404719 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:09.421852 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (6d004b05-6a87-4b7e-a216-d2b6178125a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:09.426522 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29756515-e08a-4d7a-bf40-624a7cbd7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.441667 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:09.465392 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29756515-e08a-4d7a-bf40-624a7cbd7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-385802015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31533577-ff67-464d-8076-2dcc6f413705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5ad81e73ad4ba88b6315045aef7abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:09Z,use_quota=True,user_id='3f90b25dee0148bb893dce0951c5f8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.471796 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08601a67-47e1-42b0-99ad-70bf02b135ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.474339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08601a67-47e1-42b0-99ad-70bf02b135ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.477791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1e7ad-b053-49f0-85d5-e637da68dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.481888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1e7ad-b053-49f0-85d5-e637da68dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31533577-ff67-464d-8076-2dcc6f413705', 'volume_name': 'volume-31533577-ff67-464d-8076-2dcc6f413705', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.484654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55917e40-192d-4ea6-92b5-c8f47dc73b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.487829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55917e40-192d-4ea6-92b5-c8f47dc73b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.490370 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c77b14-ac1d-4d9f-875a-ea2e00431974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.491445 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Volume 31533577-ff67-464d-8076-2dcc6f413705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31533577-ff67-464d-8076-2dcc6f413705', 'volume_size': 1} Nov 27 21:06:09.493453 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] creating volume 'volume-31533577-ff67-464d-8076-2dcc6f413705' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:09.502580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:09.628755 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:09.719358 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:09.719681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Volume volume-a847b997-af14-463d-a429-f1fae033eda3 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:09.735119 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] deleting rbd volume volume-a847b997-af14-463d-a429-f1fae033eda3 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:09.740800 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:09.742799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:09.745168 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c77b14-ac1d-4d9f-875a-ea2e00431974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31533577-ff67-464d-8076-2dcc6f413705', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.747896 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0fc57-3bc9-4eac-b155-ca159a4abdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:09.773745 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-31533577-ff67-464d-8076-2dcc6f413705 (31533577-ff67-464d-8076-2dcc6f413705): created successfully Nov 27 21:06:09.777785 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0fc57-3bc9-4eac-b155-ca159a4abdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:09.785308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (6d004b05-6a87-4b7e-a216-d2b6178125a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:09.804812 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0f0d252a-b3fb-4d52-ad2b-3852644eb0a9 tempest-VolumesListAdminTestJSON-1389470280 None] Created volume successfully. Nov 27 21:06:10.249039 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Created reservations ['1fcf8344-0693-464d-8fb9-ae6c91b17ff6', '394aaf1d-69b3-41e7-baf0-d29d53c5b4a9', '1b65cc2b-47e3-4a63-ac8b-c4c88ea0e367', '332ccfd9-8b6d-4136-a4f5-11efad173747'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:10.350965 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:10.409698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:10.496464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:10.501890 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Deleted volume successfully. Nov 27 21:06:10.535514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-95ac1054-77bd-4325-9bfb-d18d9c73442a tempest-VolumesNegativeTest-1095374484 None] Lock "b'cinder-a847b997-af14-463d-a429-f1fae033eda3-delete_volume'" released by "delete_volume" :: held 1.183s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:11.397170 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:11.407031 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:11.407819 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:11.448797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (2ec026c9-1527-42b8-a2db-f91c4855ac7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:11.458902 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac338c4-9ebc-4080-9ed8-dbe031528949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.481969 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:11.552066 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac338c4-9ebc-4080-9ed8-dbe031528949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1669695994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce57c116-275d-43bd-a806-3e77af090c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5ad81e73ad4ba88b6315045aef7abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:11Z,use_quota=True,user_id='3f90b25dee0148bb893dce0951c5f8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.566361 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a93d590-a0c7-43ee-8778-cebe0ad7e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.577748 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a93d590-a0c7-43ee-8778-cebe0ad7e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.590720 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992bbdd8-b435-431c-a076-6fec0ec12128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.604185 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992bbdd8-b435-431c-a076-6fec0ec12128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce57c116-275d-43bd-a806-3e77af090c8d', 'volume_name': 'volume-ce57c116-275d-43bd-a806-3e77af090c8d', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.610731 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41265311-65d2-4980-8bf8-1d638bc171ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.626165 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41265311-65d2-4980-8bf8-1d638bc171ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.636091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dded0c3-6f23-4ee6-9683-2a1e6c8874fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.642223 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Volume ce57c116-275d-43bd-a806-3e77af090c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce57c116-275d-43bd-a806-3e77af090c8d', 'volume_size': 1} Nov 27 21:06:11.645503 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] creating volume 'volume-ce57c116-275d-43bd-a806-3e77af090c8d' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:11.650343 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:11.811816 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:11.812618 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:11.815830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dded0c3-6f23-4ee6-9683-2a1e6c8874fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce57c116-275d-43bd-a806-3e77af090c8d', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.819769 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b31e46-e6df-4cb0-9449-4ad16ce87377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:11.846975 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-ce57c116-275d-43bd-a806-3e77af090c8d (ce57c116-275d-43bd-a806-3e77af090c8d): created successfully Nov 27 21:06:11.849699 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b31e46-e6df-4cb0-9449-4ad16ce87377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:11.858344 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Flow 'volume_create_manager' (2ec026c9-1527-42b8-a2db-f91c4855ac7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:11.881804 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3a5136a2-027a-4dd8-8336-c8431cdf6986 tempest-VolumesListAdminTestJSON-1389470280 None] Created volume successfully. Nov 27 21:06:13.989063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:13.992726 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:13.993167 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:14.014069 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Flow 'volume_create_manager' (c20eb64b-d122-4aff-82dc-c68391e33fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:14.025085 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92574b6e-330c-45de-a65c-1e81c49a3a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.040018 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:14.060223 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92574b6e-330c-45de-a65c-1e81c49a3a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9813dfe3-3822-4020-a07e-d46cc7c061b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96368817104856815838e24b41f99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:14Z,use_quota=True,user_id='81fca18f1a334877bc1c5e123857218d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.069150 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bd970-24c0-433c-8d78-1a79e0e3f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.072087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bd970-24c0-433c-8d78-1a79e0e3f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.074698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633e1336-cd17-440d-a0a8-5ab39fec03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.077062 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633e1336-cd17-440d-a0a8-5ab39fec03e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9813dfe3-3822-4020-a07e-d46cc7c061b8', 'volume_name': 'volume-9813dfe3-3822-4020-a07e-d46cc7c061b8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.079864 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81249c-39cf-44de-a70d-35f2f1e9e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.082699 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81249c-39cf-44de-a70d-35f2f1e9e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.085458 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1c50e6-59e0-4ff8-bd4d-c271a958da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.086448 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Volume 9813dfe3-3822-4020-a07e-d46cc7c061b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9813dfe3-3822-4020-a07e-d46cc7c061b8', 'volume_size': 1} Nov 27 21:06:14.087034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] creating volume 'volume-9813dfe3-3822-4020-a07e-d46cc7c061b8' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:14.089560 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:14.217150 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:14.218135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:14.222405 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1c50e6-59e0-4ff8-bd4d-c271a958da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9813dfe3-3822-4020-a07e-d46cc7c061b8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.224883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0e04c4-b790-4d8b-a3f4-4cd9abb1294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:14.236032 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Volume volume-9813dfe3-3822-4020-a07e-d46cc7c061b8 (9813dfe3-3822-4020-a07e-d46cc7c061b8): created successfully Nov 27 21:06:14.238916 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0e04c4-b790-4d8b-a3f4-4cd9abb1294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:14.249633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Flow 'volume_create_manager' (c20eb64b-d122-4aff-82dc-c68391e33fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:14.264307 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dc2a0fc3-c4d2-48bd-96c9-9f3cb45348b3 tempest-VolumesListAdminTestJSON-339867866 None] Created volume successfully. Nov 27 21:06:15.156071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Lock "b'cinder-9813dfe3-3822-4020-a07e-d46cc7c061b8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:15.209064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:15.335818 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:15.336381 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Volume volume-9813dfe3-3822-4020-a07e-d46cc7c061b8 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:15.359502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] deleting rbd volume volume-9813dfe3-3822-4020-a07e-d46cc7c061b8 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:15.382384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-ce57c116-275d-43bd-a806-3e77af090c8d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:15.434672 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:15.568002 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:15.569360 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-ce57c116-275d-43bd-a806-3e77af090c8d is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:15.597972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] deleting rbd volume volume-ce57c116-275d-43bd-a806-3e77af090c8d {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:16.150486 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Created reservations ['1107e1bd-97fd-40ab-baab-2feba7306395', 'b27746da-b139-4d15-a664-ccaf646b0a74', 'ef8e4334-2de5-4913-909d-a300515a5e62', '53609306-704f-4dfc-a7f0-cc600178616b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:16.279675 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:16.340701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:16.419687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:16.500582 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Deleted volume successfully. Nov 27 21:06:16.507241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Created reservations ['62c3c206-8699-467a-bbca-837da69db1f2', '11106744-5f7c-410f-99d0-333944a8c57a', 'd187f307-43a6-4f07-836f-1ae1edb96c61', '80e4db6b-3350-4bd9-8696-31f9a1c6abe7'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:16.533644 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-70821fe7-5072-4030-b71c-9abb14b46bc8 tempest-VolumesListAdminTestJSON-339867866 None] Lock "b'cinder-9813dfe3-3822-4020-a07e-d46cc7c061b8-delete_volume'" released by "delete_volume" :: held 1.378s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:16.587896 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:16.677922 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:16.745008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:16.751420 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Deleted volume successfully. Nov 27 21:06:16.769735 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-86c6a265-b9dc-49b7-a0ba-a0202bbf8b2e tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-ce57c116-275d-43bd-a806-3e77af090c8d-delete_volume'" released by "delete_volume" :: held 1.387s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:17.587528 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-31533577-ff67-464d-8076-2dcc6f413705-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:17.655119 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:17.743779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:17.744337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-31533577-ff67-464d-8076-2dcc6f413705 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:17.760695 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] deleting rbd volume volume-31533577-ff67-464d-8076-2dcc6f413705 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:18.147641 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Created reservations ['816bf08c-73c1-4842-bf8c-7c141cc5ea7c', 'c45dd4b2-e985-4148-82f0-d930f7f52621', '940a0bf4-eda8-4ca9-9b12-6a459f676b1e', '7e492c74-839d-4185-b3e7-371faba6469c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:18.202709 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:18.272034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:18.344579 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:18.349625 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Deleted volume successfully. Nov 27 21:06:18.365897 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6e493a1b-d826-4007-988e-c17cc5e51970 tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-31533577-ff67-464d-8076-2dcc6f413705-delete_volume'" released by "delete_volume" :: held 0.778s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:18.757712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-9a3dd7d5-d5df-461a-bf19-bedad69d73a9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:18.813649 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:18.854236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:18.854588 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Volume volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:18.860034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] deleting rbd volume volume-9a3dd7d5-d5df-461a-bf19-bedad69d73a9 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:19.147467 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Created reservations ['59f165f1-3a9d-4a53-8fc2-d923cd8d58b1', 'b433d144-6f5e-4fb5-bcae-b47f8a5a2b6a', 'dc3ac589-d236-465d-b8ba-c409586a89b0', 'ba33ae58-0590-4e01-aba4-d0988e46ad55'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:19.190658 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:19.214491 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:19.240529 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:19.245170 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Deleted volume successfully. Nov 27 21:06:19.257846 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cfaa0cb7-af71-4fe0-93d7-f8fcf3ed62c2 tempest-VolumesListAdminTestJSON-1389470280 None] Lock "b'cinder-9a3dd7d5-d5df-461a-bf19-bedad69d73a9-delete_volume'" released by "delete_volume" :: held 0.500s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:22.779876 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:22.784995 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:22.785446 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:22.797847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Flow 'volume_create_manager' (6b9ff439-1265-4828-9c08-05baec5025e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:22.801395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0198ff9-1f64-4dd2-b866-f10b225b3c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.807718 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:22.823290 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0198ff9-1f64-4dd2-b866-f10b225b3c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1375280553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1e137940-882c-4b0f-b041-564cd074c948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6932613307d5487fb2f86c52bd43f160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:23Z,use_quota=True,user_id='b2dabc2ea3044dd49789bbc25d9b1c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.825966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c22189f-ea44-46b3-9659-7715c2883261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.828397 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c22189f-ea44-46b3-9659-7715c2883261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.832126 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6240edc1-2eae-4b4d-b254-7c05a1c6538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.834662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6240edc1-2eae-4b4d-b254-7c05a1c6538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e137940-882c-4b0f-b041-564cd074c948', 'volume_name': 'volume-1e137940-882c-4b0f-b041-564cd074c948', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.837060 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fe2bd4-55b3-46f8-9a88-5b3446f2a215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.839470 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fe2bd4-55b3-46f8-9a88-5b3446f2a215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.842382 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d84437-2b40-48ad-b47c-f15e824c241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.843197 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Volume 1e137940-882c-4b0f-b041-564cd074c948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e137940-882c-4b0f-b041-564cd074c948', 'volume_size': 1} Nov 27 21:06:22.843626 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] creating volume 'volume-1e137940-882c-4b0f-b041-564cd074c948' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:22.844637 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:22.928054 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:22.928435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:22.930473 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d84437-2b40-48ad-b47c-f15e824c241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e137940-882c-4b0f-b041-564cd074c948', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.932737 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd2a6c4-27b2-4600-ac4e-9d88172549c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:22.942126 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Volume volume-1e137940-882c-4b0f-b041-564cd074c948 (1e137940-882c-4b0f-b041-564cd074c948): created successfully Nov 27 21:06:22.944417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd2a6c4-27b2-4600-ac4e-9d88172549c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:22.947448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Flow 'volume_create_manager' (6b9ff439-1265-4828-9c08-05baec5025e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:22.956289 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-16a960ca-d4e4-4a17-a1c0-bae33679feb1 tempest-SnapshotMetadataTestJSON-1814040529 None] Created volume successfully. Nov 27 21:06:24.076713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b9144d2-67b2-48bd-a0fc-1c4ef8a24233 tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:24.364844 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1b9144d2-67b2-48bd-a0fc-1c4ef8a24233 tempest-SnapshotMetadataTestJSON-1814040529 None] Create snapshot completed successfully Nov 27 21:06:25.747819 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d2d0d590-e2a5-47f8-b590-e0ee3dcd5d09 tempest-SnapshotMetadataTestJSON-1814040529 None] Lock "b'cinder-e1589ecd-cb44-4a20-833d-03aeff70193f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:25.750037 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2d0d590-e2a5-47f8-b590-e0ee3dcd5d09 tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:26.330604 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-d2d0d590-e2a5-47f8-b590-e0ee3dcd5d09 tempest-SnapshotMetadataTestJSON-1814040529 None] Created reservations ['b4dffc63-ab3a-49e0-94ac-37305e0dc7c1', 'ee521891-c51e-40d3-9e03-978a003a9983', '861ce3f5-82d9-4a2a-8f17-b6041b0387ab', '5eb6bde7-8d7f-4291-8a88-c0525c0b90a7'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:26.364821 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d2d0d590-e2a5-47f8-b590-e0ee3dcd5d09 tempest-SnapshotMetadataTestJSON-1814040529 None] Delete snapshot completed successfully. Nov 27 21:06:26.369789 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d2d0d590-e2a5-47f8-b590-e0ee3dcd5d09 tempest-SnapshotMetadataTestJSON-1814040529 None] Lock "b'cinder-e1589ecd-cb44-4a20-833d-03aeff70193f-delete_snapshot'" released by "delete_snapshot" :: held 0.622s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:26.860233 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Lock "b'cinder-1e137940-882c-4b0f-b041-564cd074c948-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:26.892086 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:26.937569 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:26.938011 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Volume volume-1e137940-882c-4b0f-b041-564cd074c948 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:26.943479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] deleting rbd volume volume-1e137940-882c-4b0f-b041-564cd074c948 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:27.257013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Created reservations ['cf31e09d-7f45-4a1d-9905-d3e7fc115dc6', '154d3cb7-3380-40dd-bcb8-3de71f65ebe5', '7b588e7b-14cc-4cd5-8223-49bf7bd782a3', 'cb544800-b449-4623-9321-64583bba44d1'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:27.308386 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:27.344488 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:27.375099 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:27.388413 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Deleted volume successfully. Nov 27 21:06:27.405564 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-10d2523b-3896-4844-954b-e40ec54d786a tempest-SnapshotMetadataTestJSON-1814040529 None] Lock "b'cinder-1e137940-882c-4b0f-b041-564cd074c948-delete_volume'" released by "delete_volume" :: held 0.545s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:28.993293 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8820f162-c8df-468f-a7e6-4b955280461e tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-828262792: creating Nov 27 21:06:29.013269 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8820f162-c8df-468f-a7e6-4b955280461e tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-828262792: created successfully Nov 27 21:06:29.032071 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8820f162-c8df-468f-a7e6-4b955280461e tempest-GroupSnapshotsTest-1872217183 None] Create group completed successfully. Nov 27 21:06:30.462899 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:30.466390 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:30.467128 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:30.480479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (21a83eaa-0887-4cee-86d5-5776ece72d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:30.484293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72fe7f5-73c1-4911-8425-cde9ee3f9808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.491493 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:30.507268 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72fe7f5-73c1-4911-8425-cde9ee3f9808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1265471684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a13d70ef-3f6a-4ce7-a140-1b8c5d74803c,host='ncdv-master-1@ceph#ceph',id=e79d4038-fc85-4c47-8d95-e92eb9465ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afbb7ecad0945e481bdcce35173b4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:30Z,use_quota=True,user_id='063ba0eab97e42a6ab426bae795ecf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46987c6a-37c8-4cc9-952d-6b631228618f),volume_type_id=46987c6a-37c8-4cc9-952d-6b631228618f)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.511313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2510d534-4f7d-4905-b9ff-7d894c23cc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.513488 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2510d534-4f7d-4905-b9ff-7d894c23cc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.520117 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4fea0e-d742-4cfb-a7a5-b41ada1c85c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.525182 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4fea0e-d742-4cfb-a7a5-b41ada1c85c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79d4038-fc85-4c47-8d95-e92eb9465ccf', 'volume_name': 'volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.535451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe206e8d-56c7-4eaa-b82f-a0e235c4beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.537569 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe206e8d-56c7-4eaa-b82f-a0e235c4beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.541443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dae8647-0a9c-4f48-af5e-512e574e52c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.558574 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Volume e79d4038-fc85-4c47-8d95-e92eb9465ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf', 'volume_size': 1} Nov 27 21:06:30.559288 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] creating volume 'volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:30.560645 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:30.635110 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:30.635695 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:30.638151 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dae8647-0a9c-4f48-af5e-512e574e52c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.641064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c438ebcc-a360-40ee-bc20-5e0dd3453296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:30.652904 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Volume volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf (e79d4038-fc85-4c47-8d95-e92eb9465ccf): created successfully Nov 27 21:06:30.656096 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c438ebcc-a360-40ee-bc20-5e0dd3453296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:30.659804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (21a83eaa-0887-4cee-86d5-5776ece72d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:30.672872 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6ddb6c65-edef-46b1-9988-d548e04e73eb tempest-GroupSnapshotsTest-1872217183 None] Created volume successfully. Nov 27 21:06:31.183494 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:31.186767 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:31.187216 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:31.199668 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Flow 'volume_create_manager' (89793924-f703-48cc-a0bf-02fbec0671c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:31.203507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4055eaaa-85a1-450c-b37c-c45c28827d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.210215 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:31.223656 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4055eaaa-85a1-450c-b37c-c45c28827d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-3422675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bb25c37b-8735-4665-9c8d-0508c8821668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5095f98d2343c580afbe3b6ca53b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:31Z,use_quota=True,user_id='db14a94ab5604fa9a7e65087f820a3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.226435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cc4982-9a7a-480d-ba58-63a93cea9798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.229021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cc4982-9a7a-480d-ba58-63a93cea9798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.231454 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2a3bf2-409b-41f5-a07d-af6cdd88e85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.233676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2a3bf2-409b-41f5-a07d-af6cdd88e85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb25c37b-8735-4665-9c8d-0508c8821668', 'volume_name': 'volume-bb25c37b-8735-4665-9c8d-0508c8821668', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.236557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f9866-422e-444f-a9c7-7a61b8a88195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.238710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f9866-422e-444f-a9c7-7a61b8a88195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.240932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be843bb-ec61-43d1-99bf-e22c67da0640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.241884 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Volume bb25c37b-8735-4665-9c8d-0508c8821668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb25c37b-8735-4665-9c8d-0508c8821668', 'volume_size': 1} Nov 27 21:06:31.242284 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] creating volume 'volume-bb25c37b-8735-4665-9c8d-0508c8821668' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:31.243276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:31.303550 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:31.303857 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:31.305937 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be843bb-ec61-43d1-99bf-e22c67da0640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb25c37b-8735-4665-9c8d-0508c8821668', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.308163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1187a331-349d-48fb-9be8-5a3cfc791350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:31.317319 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Volume volume-bb25c37b-8735-4665-9c8d-0508c8821668 (bb25c37b-8735-4665-9c8d-0508c8821668): created successfully Nov 27 21:06:31.319375 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1187a331-349d-48fb-9be8-5a3cfc791350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:31.322449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Flow 'volume_create_manager' (89793924-f703-48cc-a0bf-02fbec0671c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:31.330249 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-598fb86f-bde7-4d9b-9969-a8c9cf31d4ab tempest-VolumesTransfersTest-212584965 None] Created volume successfully. Nov 27 21:06:31.698441 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-58ac8aba-9307-420d-9776-31e395cb9a76 tempest-GroupSnapshotsTest-1872217183 None] GroupSnapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: creating. Nov 27 21:06:31.739356 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-58ac8aba-9307-420d-9776-31e395cb9a76 tempest-GroupSnapshotsTest-1872217183 None] Group snapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: creating. {{(pid=129088) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Nov 27 21:06:31.756099 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-58ac8aba-9307-420d-9776-31e395cb9a76 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:32.611963 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-58ac8aba-9307-420d-9776-31e395cb9a76 tempest-GroupSnapshotsTest-1872217183 None] group_snapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: created successfully Nov 27 21:06:32.948410 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-25a47062-742c-4363-a026-9151a89fe0bd tempest-VolumesTransfersTest-1441529181 None] Transfer volume completed successfully. Nov 27 21:06:33.580460 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Lock "b'cinder-bb25c37b-8735-4665-9c8d-0508c8821668-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:33.629145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] cloning volumes/volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf@snapshot-5eea8054-2846-4569-bbb8-ac4ef2951bfd to volume-70d67f27-b50b-4d64-a43d-a7f486349ee0 {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:06:33.630106 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:33.687978 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:33.751073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:33.853145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:33.853811 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Volume volume-bb25c37b-8735-4665-9c8d-0508c8821668 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:33.863507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] deleting rbd volume volume-bb25c37b-8735-4665-9c8d-0508c8821668 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:33.875752 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:33.876037 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:33.881874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:33.954605 ncdv-master-1 cinder-volume[129088]: WARNING cinder.volume.drivers.rbd [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Nov 27 21:06:34.128531 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-756fc623-e2b6-4ccb-a892-7dd9e417e119 tempest-GroupSnapshotsTest-1872217183 None] Create group from source-snapshot-b2850ef5-d1d1-4e9e-a22c-960c437da754 completed successfully. Nov 27 21:06:34.222427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Created reservations ['9767165f-4760-412c-b400-4d1a1124fb3c', '7136cfc7-edf2-4166-b921-e3d1d315d7fa', 'e8106127-f6cd-4cdf-a1a9-8c59a3437e48', 'f285c505-dde0-49a7-abb1-8b3d8a03ab31'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:34.292516 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:34.357325 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:34.416090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:34.421517 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Deleted volume successfully. Nov 27 21:06:34.450582 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0e3b06c4-6d29-4a00-a118-1c7e8c0ace29 tempest-VolumesTransfersTest-1261673975 None] Lock "b'cinder-bb25c37b-8735-4665-9c8d-0508c8821668-delete_volume'" released by "delete_volume" :: held 0.871s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:35.043662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:35.054273 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:35.054914 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:35.072232 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Flow 'volume_create_manager' (a6fe790f-3eef-4343-8aa5-8c56b5363488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:35.082157 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552ad765-a8db-4387-89fe-b3eec44bd147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.094642 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:35.108958 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552ad765-a8db-4387-89fe-b3eec44bd147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-974424820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d5d585cb-5b5b-433e-a4ac-9537f152e674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5095f98d2343c580afbe3b6ca53b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:35Z,use_quota=True,user_id='db14a94ab5604fa9a7e65087f820a3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.111975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461957d7-6173-4d8d-a0d0-62c79be9b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.114547 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461957d7-6173-4d8d-a0d0-62c79be9b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.117312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fbb2b0-51d0-4db3-8684-992a97e3346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.120044 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fbb2b0-51d0-4db3-8684-992a97e3346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d585cb-5b5b-433e-a4ac-9537f152e674', 'volume_name': 'volume-d5d585cb-5b5b-433e-a4ac-9537f152e674', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.123029 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ff411-4889-4d0e-b157-9cbe1dde0ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.125296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ff411-4889-4d0e-b157-9cbe1dde0ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.128081 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba983c-08a1-44f0-8d98-ef6b052f0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.129015 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Volume d5d585cb-5b5b-433e-a4ac-9537f152e674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d585cb-5b5b-433e-a4ac-9537f152e674', 'volume_size': 1} Nov 27 21:06:35.129421 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] creating volume 'volume-d5d585cb-5b5b-433e-a4ac-9537f152e674' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:35.130410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:35.219735 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:35.220184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:35.222284 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba983c-08a1-44f0-8d98-ef6b052f0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d585cb-5b5b-433e-a4ac-9537f152e674', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.225209 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8574de-363a-4fef-bb4a-178e4301e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:35.238617 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Volume volume-d5d585cb-5b5b-433e-a4ac-9537f152e674 (d5d585cb-5b5b-433e-a4ac-9537f152e674): created successfully Nov 27 21:06:35.244246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8574de-363a-4fef-bb4a-178e4301e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:35.271047 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Flow 'volume_create_manager' (a6fe790f-3eef-4343-8aa5-8c56b5363488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:35.301858 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0d96739b-af71-4fa4-b38e-ea1d34c44e9a tempest-VolumesTransfersTest-212584965 None] Created volume successfully. Nov 27 21:06:35.328781 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:35.394600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:35.401459 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] deleting rbd volume volume-70d67f27-b50b-4d64-a43d-a7f486349ee0 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:35.798498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['d637a8c6-f334-454b-a4cc-0d2a390d7f00'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:35.826321 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1731033487 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1731033487, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:35.827623 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1731033487 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1731033487, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:35.848154 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['25c8bf73-dbb1-4c42-9c0e-1d687ef8a68a', 'a6b0c85b-653b-478f-847d-0c91c14b6608', 'aa207de5-21ee-4a76-8bac-20e3515d425a', '30c03909-6948-4477-9d32-8e25bb58df3e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:35.953518 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:36.048442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:36.175600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:36.179811 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-70323329-62c6-4e4d-9893-a3e770229483 tempest-GroupSnapshotsTest-1872217183 None] Delete group completed successfully. Nov 27 21:06:36.541095 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] group_snapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: deleting Nov 27 21:06:36.578711 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] group_snapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: deleting {{(pid=129088) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Nov 27 21:06:36.649188 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:36.781864 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Lock "b'cinder-d5d585cb-5b5b-433e-a4ac-9537f152e674-delete_volume'" acquired by "delete_volume" :: waited 0.136s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:36.835157 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:36.920828 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:36.921639 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Volume volume-d5d585cb-5b5b-433e-a4ac-9537f152e674 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:36.935211 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] deleting rbd volume volume-d5d585cb-5b5b-433e-a4ac-9537f152e674 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:37.173497 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Created reservations ['bc0dd869-ab7e-4a90-928b-63149f43f436', 'c42e4045-5df5-41dc-9f28-d98dc4ac5f44', '983123b3-af99-4aeb-b4ee-50832f591537', '97229b39-c206-4e8e-93ab-5abdae71ac44'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:37.227511 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:37.268237 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:37.296472 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:37.309828 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Deleted volume successfully. Nov 27 21:06:37.340194 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-15c1a2dd-923b-4ca3-89d0-1f592054072b tempest-VolumesTransfersTest-1261673975 None] Lock "b'cinder-d5d585cb-5b5b-433e-a4ac-9537f152e674-delete_volume'" released by "delete_volume" :: held 0.558s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:37.632619 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1731033487 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1731033487, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:37.660748 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['9fab7820-4644-426d-9cc7-3d60c2cfbe44', '045cb227-1500-437e-99f8-b5cfe4746842', 'd155ce8c-6b1c-48ee-a3d4-cda7ad9f13c8', 'f23aa271-7f51-49ad-a5fb-17421349209f'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:37.757624 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-30081ba8-feb2-43f1-949a-b85f479f21da tempest-GroupSnapshotsTest-1872217183 None] group_snapshot b2850ef5-d1d1-4e9e-a22c-960c437da754: deleted successfully Nov 27 21:06:38.198911 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:38.284214 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:38.285290 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Volume volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:38.296953 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] deleting rbd volume volume-e79d4038-fc85-4c47-8d95-e92eb9465ccf {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:38.690603 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['327dae8e-3997-4092-8a31-8a0855e67fb4'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:38.729744 ncdv-master-1 cinder-volume[129088]: WARNING cinder.db.sqlalchemy.api [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1731033487'] Nov 27 21:06:38.741116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['c987cdf0-8f67-4b7c-a209-1b479feab3f3', 'e0c5880b-5e02-47be-8c54-3d8a6bbb600d', '078fdb1d-d9b3-46ef-ab59-79bb358c04ac', '33b14bd7-622d-486e-aa6e-8d0ceddc1761'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:38.864709 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:38.957920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:39.043519 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:39.062031 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8494156f-74bd-4e7c-b73f-473bbc62642d tempest-GroupSnapshotsTest-1872217183 None] Delete group completed successfully. Nov 27 21:06:39.730069 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c553b879-3cfc-40ec-8896-4764f0cddcc7 tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-929958850: creating Nov 27 21:06:39.778580 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c553b879-3cfc-40ec-8896-4764f0cddcc7 tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-929958850: created successfully Nov 27 21:06:39.795235 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c553b879-3cfc-40ec-8896-4764f0cddcc7 tempest-GroupSnapshotsTest-1872217183 None] Create group completed successfully. Nov 27 21:06:41.252596 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:41.257304 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:41.258130 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:41.276180 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (03f2ecea-5064-41f0-a253-33f9c42d639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:41.281095 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fa6ab5-1683-4c3e-95c6-12bfbc2285e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.290019 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:41.307025 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fa6ab5-1683-4c3e-95c6-12bfbc2285e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1287348305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25b66e5a-4c74-49c4-87df-bd35679a489a,host='ncdv-master-1@ceph#ceph',id=20c2c77e-0710-44fb-9de2-e64ed79e8fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afbb7ecad0945e481bdcce35173b4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:41Z,use_quota=True,user_id='063ba0eab97e42a6ab426bae795ecf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badd771b-fd20-49b5-823c-fbb7bf0b061e),volume_type_id=badd771b-fd20-49b5-823c-fbb7bf0b061e)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.310625 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d655ed34-baf5-4bf5-a935-37a9fa684a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.313740 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d655ed34-baf5-4bf5-a935-37a9fa684a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.316421 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185a0cd9-2f94-4944-8096-1f771304bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.319596 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185a0cd9-2f94-4944-8096-1f771304bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c2c77e-0710-44fb-9de2-e64ed79e8fe2', 'volume_name': 'volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.323275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b051cf4-0f6e-439d-a14e-65e12eac5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.330036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b051cf4-0f6e-439d-a14e-65e12eac5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.334178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79daabe1-0ba1-4c40-8d33-f07e62ab023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.354388 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Volume 20c2c77e-0710-44fb-9de2-e64ed79e8fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2', 'volume_size': 1} Nov 27 21:06:41.354806 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] creating volume 'volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:41.355874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:41.459437 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:41.459889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:41.462805 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79daabe1-0ba1-4c40-8d33-f07e62ab023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.465476 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0652e6e6-43c5-4dc9-b1a2-183133dccdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:41.484089 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Volume volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2 (20c2c77e-0710-44fb-9de2-e64ed79e8fe2): created successfully Nov 27 21:06:41.487048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0652e6e6-43c5-4dc9-b1a2-183133dccdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:41.491148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (03f2ecea-5064-41f0-a253-33f9c42d639f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:41.503232 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-69b4799d-6409-4329-b129-927f8b4af2b7 tempest-GroupSnapshotsTest-1872217183 None] Created volume successfully. Nov 27 21:06:42.825632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:42.831764 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:42.832963 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:42.846093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (1068b714-1180-4485-aaa9-c891f27baf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:42.850382 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0afcf7-c14a-4ae9-bd98-796f5ce9f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.861090 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:42.877408 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0afcf7-c14a-4ae9-bd98-796f5ce9f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1887903494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25b66e5a-4c74-49c4-87df-bd35679a489a,host='ncdv-master-1@ceph#ceph',id=ea098c99-d459-4f32-8395-4dbf49d10744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afbb7ecad0945e481bdcce35173b4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:43Z,use_quota=True,user_id='063ba0eab97e42a6ab426bae795ecf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(badd771b-fd20-49b5-823c-fbb7bf0b061e),volume_type_id=badd771b-fd20-49b5-823c-fbb7bf0b061e)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.880235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69434f40-87f5-411b-b65e-61c950c4b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.882509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69434f40-87f5-411b-b65e-61c950c4b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.885411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948eb4f-d832-4d14-852c-844b56fcdfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.887631 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d948eb4f-d832-4d14-852c-844b56fcdfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea098c99-d459-4f32-8395-4dbf49d10744', 'volume_name': 'volume-ea098c99-d459-4f32-8395-4dbf49d10744', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.889904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6debc69-b338-40ee-bb76-527f9043e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.893215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6debc69-b338-40ee-bb76-527f9043e43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.895424 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89e95ea-5eb6-40c5-b711-a7fe7453fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.909764 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Volume ea098c99-d459-4f32-8395-4dbf49d10744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea098c99-d459-4f32-8395-4dbf49d10744', 'volume_size': 1} Nov 27 21:06:42.910239 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] creating volume 'volume-ea098c99-d459-4f32-8395-4dbf49d10744' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:42.911326 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:42.976723 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:42.977109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:42.979175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89e95ea-5eb6-40c5-b711-a7fe7453fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea098c99-d459-4f32-8395-4dbf49d10744', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.981355 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f3b8ea-829f-4344-bff8-ea30e74abfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:42.991514 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Volume volume-ea098c99-d459-4f32-8395-4dbf49d10744 (ea098c99-d459-4f32-8395-4dbf49d10744): created successfully Nov 27 21:06:42.994133 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f3b8ea-829f-4344-bff8-ea30e74abfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:42.997663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (1068b714-1180-4485-aaa9-c891f27baf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:43.006344 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fbaa608b-6443-48cd-9221-33b1af10b95e tempest-GroupSnapshotsTest-1872217183 None] Created volume successfully. Nov 27 21:06:43.267305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:43.270503 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:43.270942 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:43.282775 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Flow 'volume_create_manager' (8403e845-09dd-44ac-8832-fd84d9975e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:43.288348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e489bd-ecd5-4285-b230-57d27cd5a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.294450 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:43.327473 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e489bd-ecd5-4285-b230-57d27cd5a043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796543787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6032ba5a-c1ae-4962-92c0-250d5379a789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916d44620e3418a8916382d00618dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:43Z,use_quota=True,user_id='bd92ea56b41244a58e3a959f665431c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.330670 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ae67bb-c71c-4e45-af8c-a4d50d437341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.332816 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ae67bb-c71c-4e45-af8c-a4d50d437341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.335194 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac76abc8-4835-416d-91b4-4a92f6c94c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.337431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac76abc8-4835-416d-91b4-4a92f6c94c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6032ba5a-c1ae-4962-92c0-250d5379a789', 'volume_name': 'volume-6032ba5a-c1ae-4962-92c0-250d5379a789', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.339760 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddeb4e6-ef93-427b-8d5c-6266574af91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.341841 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddeb4e6-ef93-427b-8d5c-6266574af91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.344061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170643bb-0e79-4028-a8ca-ccc7cb9fa6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.344937 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Volume 6032ba5a-c1ae-4962-92c0-250d5379a789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6032ba5a-c1ae-4962-92c0-250d5379a789', 'volume_size': 1} Nov 27 21:06:43.345331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] creating volume 'volume-6032ba5a-c1ae-4962-92c0-250d5379a789' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:43.346294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:43.395300 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:43.395300 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:43.397151 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170643bb-0e79-4028-a8ca-ccc7cb9fa6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6032ba5a-c1ae-4962-92c0-250d5379a789', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.399306 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab64eef6-6515-4b4f-95bb-f3daec6c448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:43.408317 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Volume volume-6032ba5a-c1ae-4962-92c0-250d5379a789 (6032ba5a-c1ae-4962-92c0-250d5379a789): created successfully Nov 27 21:06:43.410340 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab64eef6-6515-4b4f-95bb-f3daec6c448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:43.413287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Flow 'volume_create_manager' (8403e845-09dd-44ac-8832-fd84d9975e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:43.420774 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-eb5f6648-5fe2-462c-83f1-4b955222cc0d tempest-VolumesActionsTest-24419802 None] Created volume successfully. Nov 27 21:06:43.984991 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-22317512-e544-43aa-a1c3-0a7c327713cb tempest-GroupSnapshotsTest-1872217183 None] Update group completed successfully. Nov 27 21:06:45.180640 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2cfec211-7d56-44ef-8d24-e2a216b22eec tempest-GroupSnapshotsTest-1872217183 None] Update group completed successfully. Nov 27 21:06:46.381676 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-37d249ad-f174-43e7-a021-f880fb1a7e04 tempest-GroupSnapshotsTest-1872217183 None] Update group completed successfully. Nov 27 21:06:47.563472 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-15b81f3b-5ee2-4256-80fa-e9d11d65261a tempest-GroupSnapshotsTest-1872217183 None] Update group completed successfully. Nov 27 21:06:48.879867 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-da716a7c-07d4-4a8e-b4c5-1f54aa4b6d5a tempest-GroupSnapshotsTest-1872217183 None] GroupSnapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: creating. Nov 27 21:06:48.898363 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da716a7c-07d4-4a8e-b4c5-1f54aa4b6d5a tempest-GroupSnapshotsTest-1872217183 None] Group snapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: creating. {{(pid=129088) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Nov 27 21:06:48.916890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da716a7c-07d4-4a8e-b4c5-1f54aa4b6d5a tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:49.464799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da716a7c-07d4-4a8e-b4c5-1f54aa4b6d5a tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:50.535160 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-da716a7c-07d4-4a8e-b4c5-1f54aa4b6d5a tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: created successfully Nov 27 21:06:51.108824 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: deleting Nov 27 21:06:51.126198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: deleting {{(pid=129088) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Nov 27 21:06:51.142214 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:51.497712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:52.622450 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1484818142 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1484818142, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:52.623232 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1484818142 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1484818142, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:52.640274 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['95a243a0-5cd8-4e66-bd04-4468e8ac1f76', '7b4ce475-6807-42ac-a2af-b0218825e4b3', 'a7dece1b-f82d-4e99-8d09-3920003e809b', 'bf1fdf4b-0065-4fce-a306-ce3f51ae286a'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:52.714682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['acb708f6-decc-43ce-a4ea-6f46a2b60e88', '2f3bde15-6e21-4801-a71d-abfe90c0d7b0', '862f9951-93a5-4705-939e-1ca5c9679d83', '9c8ef7a4-c431-4c5a-ae4f-85deda18ec21'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:52.760165 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ed0cd8e7-eded-4bdb-ae3d-e21cf7af6dfa tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 8438fecf-76fd-4b5f-8290-7544f5a0d46b: deleted successfully Nov 27 21:06:53.623100 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:53.683971 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:53.684399 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Volume volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:53.690349 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] deleting rbd volume volume-20c2c77e-0710-44fb-9de2-e64ed79e8fe2 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:53.926038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:53.965880 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:06:53.966313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Volume volume-ea098c99-d459-4f32-8395-4dbf49d10744 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:06:53.971316 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] deleting rbd volume volume-ea098c99-d459-4f32-8395-4dbf49d10744 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:06:54.217936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['bf749a99-5877-4734-8f94-be050396df58'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:54.234065 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1484818142 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1484818142, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:06:54.248463 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['7ab6ff5a-303b-4da5-a8e0-32e6a9046ac0', '1adfa49f-a2ff-41ff-ad1b-694955acdefd', '929472de-6dc6-4eb0-a309-6c82727ea5d9', 'a8db6cd0-8178-4288-8911-893bd593b0aa'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:54.319828 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['2f27494f-7102-4dd8-9566-0cc98c4ebe8a', '4fd4a629-5f31-4620-84e7-3a683196e0a3', 'b5a98813-bd57-4f43-afe5-b36a94ab8d1d', 'c5bfa63a-61d7-4bee-90dd-f7db0486f5e4'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:06:54.394590 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:54.422244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:54.456203 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:54.460760 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ad6ab7c8-6d38-4fe8-8ec5-1b6f4f3428a8 tempest-GroupSnapshotsTest-1872217183 None] Delete group completed successfully. Nov 27 21:06:55.052158 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6a729240-aae5-4cfa-932a-7fe2b21a6b87 tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-1594815215: creating Nov 27 21:06:55.072718 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6a729240-aae5-4cfa-932a-7fe2b21a6b87 tempest-GroupSnapshotsTest-1872217183 None] Group tempest-GroupSnapshotsTest-Group-1594815215: created successfully Nov 27 21:06:55.082247 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6a729240-aae5-4cfa-932a-7fe2b21a6b87 tempest-GroupSnapshotsTest-1872217183 None] Create group completed successfully. Nov 27 21:06:56.608415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:06:56.612750 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:06:56.613261 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:06:56.627492 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (989b4b45-4d3f-423e-a42b-b3419c35db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:56.630853 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb88c9e5-07c4-44a6-9fac-c9bc9bc973f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.637697 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:06:56.654779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb88c9e5-07c4-44a6-9fac-c9bc9bc973f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1448556973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07b44759-1da6-469e-8a4b-a43ec6d06a72,host='ncdv-master-1@ceph#ceph',id=3ad50e89-557e-4b41-a609-2519caa44cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7afbb7ecad0945e481bdcce35173b4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:06:57Z,use_quota=True,user_id='063ba0eab97e42a6ab426bae795ecf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf8e2959-7b05-4783-a7bf-ecd89b145d30),volume_type_id=bf8e2959-7b05-4783-a7bf-ecd89b145d30)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.657666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f545fbdb-7287-492a-a532-69f74ece137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.660537 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f545fbdb-7287-492a-a532-69f74ece137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.663380 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269b087-57fd-4dac-b214-4071bc7379d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.665881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5269b087-57fd-4dac-b214-4071bc7379d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad50e89-557e-4b41-a609-2519caa44cb8', 'volume_name': 'volume-3ad50e89-557e-4b41-a609-2519caa44cb8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.668543 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c48b4-5f7a-4854-9c24-9ae1cf095429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.670957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c48b4-5f7a-4854-9c24-9ae1cf095429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.673596 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148ba4a1-42f5-4821-aa0a-a1cd8c8dcd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.691648 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Volume 3ad50e89-557e-4b41-a609-2519caa44cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad50e89-557e-4b41-a609-2519caa44cb8', 'volume_size': 1} Nov 27 21:06:56.692483 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] creating volume 'volume-3ad50e89-557e-4b41-a609-2519caa44cb8' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:06:56.693566 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:56.791219 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:06:56.791822 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:06:56.794093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148ba4a1-42f5-4821-aa0a-a1cd8c8dcd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad50e89-557e-4b41-a609-2519caa44cb8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.796534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b032194e-ddf9-4caa-b982-8f83b14be28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:06:56.805425 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Volume volume-3ad50e89-557e-4b41-a609-2519caa44cb8 (3ad50e89-557e-4b41-a609-2519caa44cb8): created successfully Nov 27 21:06:56.807423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b032194e-ddf9-4caa-b982-8f83b14be28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:06:56.810411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Flow 'volume_create_manager' (989b4b45-4d3f-423e-a42b-b3419c35db29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:06:56.828731 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-586bc486-f7d5-436b-9611-ed515c3d3377 tempest-GroupSnapshotsTest-1872217183 None] Created volume successfully. Nov 27 21:06:57.130367 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-58f56c19-3fb2-442f-8347-bbb57ddb91c4 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789'" acquired by "attach_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:57.184917 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-58f56c19-3fb2-442f-8347-bbb57ddb91c4 tempest-VolumesActionsTest-24419802 None] Attaching volume 6032ba5a-c1ae-4962-92c0-250d5379a789 to instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 at mountpoint /dev/sdb on host None. Nov 27 21:06:57.216270 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-58f56c19-3fb2-442f-8347-bbb57ddb91c4 tempest-VolumesActionsTest-24419802 None] Attach volume completed successfully. Nov 27 21:06:57.221554 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-58f56c19-3fb2-442f-8347-bbb57ddb91c4 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789'" released by "attach_volume" :: held 0.091s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:57.340368 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ea083fda-dbeb-4e94-bb22-65b343062ef2 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:06:57.340852 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ea083fda-dbeb-4e94-bb22-65b343062ef2 tempest-VolumesActionsTest-24419802 None] Detaching volume 6032ba5a-c1ae-4962-92c0-250d5379a789 from instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931. Nov 27 21:06:57.387229 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ea083fda-dbeb-4e94-bb22-65b343062ef2 tempest-VolumesActionsTest-24419802 None] Detach volume completed successfully. Nov 27 21:06:57.393369 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ea083fda-dbeb-4e94-bb22-65b343062ef2 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-detach_volume'" released by "detach_volume" :: held 0.053s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:06:57.857190 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6d45f542-3f23-4552-b6c6-b67cfbb9f112 tempest-GroupSnapshotsTest-1872217183 None] GroupSnapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: creating. Nov 27 21:06:57.894811 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6d45f542-3f23-4552-b6c6-b67cfbb9f112 tempest-GroupSnapshotsTest-1872217183 None] Group snapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: creating. {{(pid=129088) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Nov 27 21:06:57.905189 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:06:57.906210 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:57.986033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:58.039178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:06:58.054890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6d45f542-3f23-4552-b6c6-b67cfbb9f112 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:06:58.599283 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6d45f542-3f23-4552-b6c6-b67cfbb9f112 tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: created successfully Nov 27 21:06:59.155009 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: deleting Nov 27 21:06:59.198004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: deleting {{(pid=129088) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Nov 27 21:06:59.232030 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:00.518545 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-100094805 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-100094805, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:00.519463 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-100094805 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-100094805, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:00.534653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['1143e19a-dc50-4da1-9e75-8c992f4369ec', '726df635-683b-432a-a88b-a40969fd45d3', '885819f2-edcf-42f4-935e-0a66649da12c', 'bf696ebc-957b-4687-845e-7392761e7c3c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:00.579855 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-02863634-32fd-4c35-a986-ea24dd5df296 tempest-GroupSnapshotsTest-1872217183 None] group_snapshot 65ae4ac1-b6ef-43e4-bbd8-a0ec6adae97f: deleted successfully Nov 27 21:07:01.767171 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:01.900083 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:01.900581 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Volume volume-3ad50e89-557e-4b41-a609-2519caa44cb8 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:01.914974 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] deleting rbd volume volume-3ad50e89-557e-4b41-a609-2519caa44cb8 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:02.206631 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:02.209788 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:02.210235 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:02.223726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Flow 'volume_create_manager' (740366a0-b308-4682-9ca2-85e408fb8d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:02.226886 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ad7869-ef74-4b6f-ac8d-46d0f14fc827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.238586 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:02.251771 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ad7869-ef74-4b6f-ac8d-46d0f14fc827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-987432113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b00e3144-c126-4707-91c1-6b49f923c0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcfaa0229934ca2881bd510e1a2aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:02Z,use_quota=True,user_id='0b931665afff4f99b4804188e9ae1438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.254394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf754e3-ab49-4628-b2b2-22e65dcacc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.257020 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf754e3-ab49-4628-b2b2-22e65dcacc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.260071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0863fffb-2c43-4727-9213-0e75a2bc79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.262392 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0863fffb-2c43-4727-9213-0e75a2bc79b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00e3144-c126-4707-91c1-6b49f923c0fd', 'volume_name': 'volume-b00e3144-c126-4707-91c1-6b49f923c0fd', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.264726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e80543-4896-4870-a2a2-a0bbd5e4360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.267375 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e80543-4896-4870-a2a2-a0bbd5e4360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.269574 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7f28e9-0697-4fa3-83cf-b12eccd2fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.270347 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume b00e3144-c126-4707-91c1-6b49f923c0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00e3144-c126-4707-91c1-6b49f923c0fd', 'volume_size': 1} Nov 27 21:07:02.270736 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] creating volume 'volume-b00e3144-c126-4707-91c1-6b49f923c0fd' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:02.272243 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:02.304704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['518d7a66-3563-4e9f-a1d8-06b9c7a3a091'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:02.324607 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-100094805 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-100094805, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:02.335307 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:02.335696 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:02.337726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7f28e9-0697-4fa3-83cf-b12eccd2fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00e3144-c126-4707-91c1-6b49f923c0fd', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.339961 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a4e4f1-d4c6-4619-b5f9-571530c2dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:02.349858 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume volume-b00e3144-c126-4707-91c1-6b49f923c0fd (b00e3144-c126-4707-91c1-6b49f923c0fd): created successfully Nov 27 21:07:02.351717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a4e4f1-d4c6-4619-b5f9-571530c2dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:02.354643 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Flow 'volume_create_manager' (740366a0-b308-4682-9ca2-85e408fb8d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:02.358561 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Created reservations ['576437ce-cf7d-4e58-880d-259a48cc4d93', '802cd92b-c8a1-4330-ae55-4d894c72aa09', '3b5bc9cc-c599-4386-b60b-e72fcf33fcf2', 'c948529d-6238-4c38-beac-b84076767ad6'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:02.365831 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5ee2448f-1f23-427c-a907-1932025293e4 tempest-ServerRescueNegativeTestJSON-609742415 None] Created volume successfully. Nov 27 21:07:02.438439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:02.469592 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:02.498606 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:02.502543 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-673a7ba5-f8e0-4ca7-850b-b43859136fdc tempest-GroupSnapshotsTest-1872217183 None] Delete group completed successfully. Nov 27 21:07:07.673053 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dd0ccf3d-7c47-49fc-8314-fb54801e6594 tempest-GroupsTest-1500057733 None] Group tempest-Group1-2141275872: creating Nov 27 21:07:07.693156 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dd0ccf3d-7c47-49fc-8314-fb54801e6594 tempest-GroupsTest-1500057733 None] Group tempest-Group1-2141275872: created successfully Nov 27 21:07:07.702259 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dd0ccf3d-7c47-49fc-8314-fb54801e6594 tempest-GroupsTest-1500057733 None] Create group completed successfully. Nov 27 21:07:08.851307 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee2ee970-c367-467b-8c33-513ae499085f tempest-GroupsTest-1500057733 None] Group tempest-Group2-246012298: creating Nov 27 21:07:08.874587 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee2ee970-c367-467b-8c33-513ae499085f tempest-GroupsTest-1500057733 None] Group tempest-Group2-246012298: created successfully Nov 27 21:07:08.886592 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee2ee970-c367-467b-8c33-513ae499085f tempest-GroupsTest-1500057733 None] Create group completed successfully. Nov 27 21:07:10.220946 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:10.225801 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:10.226252 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:10.239780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (0999927b-0a0b-414e-802c-cf728903ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:10.242927 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f311b3e-270b-47dd-82f4-dcfdcd6552fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.249402 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:10.262013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f311b3e-270b-47dd-82f4-dcfdcd6552fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-120029937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b1988bf2-cba2-4636-8847-bab3c588f586,host='ncdv-master-1@ceph#ceph',id=702190c3-4048-40c4-b734-497cedd1191b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01631e590ebe4902a5848693921c36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:10Z,use_quota=True,user_id='b4a0ffea69144229864909cd516d0be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37fcc260-20f6-4697-83d1-b0512391986e),volume_type_id=37fcc260-20f6-4697-83d1-b0512391986e)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.264635 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c30809-9a65-451f-ac2e-8ec182ffab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.266784 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c30809-9a65-451f-ac2e-8ec182ffab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.269829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba371267-a2ad-4447-a565-f9178db6434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.272089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba371267-a2ad-4447-a565-f9178db6434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702190c3-4048-40c4-b734-497cedd1191b', 'volume_name': 'volume-702190c3-4048-40c4-b734-497cedd1191b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.274449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ed56c7-13cd-4015-8d86-dfdcdced7927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.276587 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ed56c7-13cd-4015-8d86-dfdcdced7927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.278848 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63bfedc-59ce-4c85-9e62-b80a8e226cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.293004 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Volume 702190c3-4048-40c4-b734-497cedd1191b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702190c3-4048-40c4-b734-497cedd1191b', 'volume_size': 1} Nov 27 21:07:10.293411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] creating volume 'volume-702190c3-4048-40c4-b734-497cedd1191b' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:10.294450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:10.350276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:10.351197 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:10.352754 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63bfedc-59ce-4c85-9e62-b80a8e226cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702190c3-4048-40c4-b734-497cedd1191b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.354959 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b83aa-0138-4718-81ed-3d84d7f81626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:10.363712 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Volume volume-702190c3-4048-40c4-b734-497cedd1191b (702190c3-4048-40c4-b734-497cedd1191b): created successfully Nov 27 21:07:10.365741 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b83aa-0138-4718-81ed-3d84d7f81626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:10.368753 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (0999927b-0a0b-414e-802c-cf728903ba18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:10.377795 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d7621614-487b-436c-9006-b35bb27191f3 tempest-GroupsTest-1500057733 None] Created volume successfully. Nov 27 21:07:11.683963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:11.728271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:11.728784 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Volume volume-702190c3-4048-40c4-b734-497cedd1191b is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:11.734152 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] deleting rbd volume volume-702190c3-4048-40c4-b734-497cedd1191b {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:11.920852 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Created reservations ['d4afc261-ec69-4cca-a6f9-61554a2863b5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:11.938114 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1599143918 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1599143918, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:11.939425 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1599143918 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1599143918, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:11.951661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Created reservations ['d120fbc9-a3a6-418a-94be-07b9f24590e6', 'ea82b514-c2e3-4437-9c29-a7c10f34fc4f', '5c187cce-b300-4bc6-b8b7-6439fbcc1007', 'a3280904-4682-47ca-87e2-1e90b0d8e916'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:12.020536 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:12.041832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:12.063439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:12.067744 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-54023586-d1d1-422e-941f-33f67a96a0de tempest-GroupsTest-1500057733 None] Delete group completed successfully. Nov 27 21:07:12.873948 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-f660d0f5-315e-4c6a-aed2-fe3fcdc34942 tempest-GroupsTest-1500057733 None] Created reservations ['0230f3b5-9ab8-410b-ab38-bc59ef5b2271'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:12.907983 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f660d0f5-315e-4c6a-aed2-fe3fcdc34942 tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:12.931517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f660d0f5-315e-4c6a-aed2-fe3fcdc34942 tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:12.952933 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-f660d0f5-315e-4c6a-aed2-fe3fcdc34942 tempest-GroupsTest-1500057733 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:12.957709 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f660d0f5-315e-4c6a-aed2-fe3fcdc34942 tempest-GroupsTest-1500057733 None] Delete group completed successfully. Nov 27 21:07:14.088776 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d331ff54-a79b-4c0c-ad61-9bb249088c68 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789'" acquired by "attach_volume" :: waited 0.022s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:14.128087 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d331ff54-a79b-4c0c-ad61-9bb249088c68 tempest-VolumesActionsTest-24419802 None] Attaching volume 6032ba5a-c1ae-4962-92c0-250d5379a789 to instance 16495f29-b412-4fc8-8851-21f4471f7247 at mountpoint /dev/sdb on host None. Nov 27 21:07:14.155695 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d331ff54-a79b-4c0c-ad61-9bb249088c68 tempest-VolumesActionsTest-24419802 None] Attach volume completed successfully. Nov 27 21:07:14.162955 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d331ff54-a79b-4c0c-ad61-9bb249088c68 tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789'" released by "attach_volume" :: held 0.074s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:14.355684 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a6a5877e-2aca-4cb6-bb29-b802e59b899c tempest-GroupsTest-1500057733 None] Group tempest-GroupsTest-Group-2025776350: creating Nov 27 21:07:14.370091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-60ef9db1-7d1a-43d9-b451-efb043a1fe4f tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-detach_volume'" acquired by "detach_volume" :: waited 0.023s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:14.371052 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-60ef9db1-7d1a-43d9-b451-efb043a1fe4f tempest-VolumesActionsTest-24419802 None] Detaching volume 6032ba5a-c1ae-4962-92c0-250d5379a789 from instance 16495f29-b412-4fc8-8851-21f4471f7247. Nov 27 21:07:14.379673 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a6a5877e-2aca-4cb6-bb29-b802e59b899c tempest-GroupsTest-1500057733 None] Group tempest-GroupsTest-Group-2025776350: created successfully Nov 27 21:07:14.389429 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a6a5877e-2aca-4cb6-bb29-b802e59b899c tempest-GroupsTest-1500057733 None] Create group completed successfully. Nov 27 21:07:14.430870 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-60ef9db1-7d1a-43d9-b451-efb043a1fe4f tempest-VolumesActionsTest-24419802 None] Detach volume completed successfully. Nov 27 21:07:14.435420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-60ef9db1-7d1a-43d9-b451-efb043a1fe4f tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-detach_volume'" released by "detach_volume" :: held 0.065s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:15.680275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:15.683787 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:15.684234 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:15.696428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (4ec11d9c-816a-4622-a4ab-a53c55172eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:15.699719 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba9da66-a54b-4ed1-927f-6b439b3be68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.705797 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:15.717792 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba9da66-a54b-4ed1-927f-6b439b3be68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1546872414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1a596f2-65ac-4df4-b0dd-13cc738464c8,host='ncdv-master-1@ceph#ceph',id=3930be7d-97b3-4105-a33c-27fcb695752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01631e590ebe4902a5848693921c36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:16Z,use_quota=True,user_id='b4a0ffea69144229864909cd516d0be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c70fdec8-4fad-424b-bc98-560fcb337888),volume_type_id=c70fdec8-4fad-424b-bc98-560fcb337888)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.720404 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8122680-9630-4abf-8383-fc9f26e6b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.723056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8122680-9630-4abf-8383-fc9f26e6b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.725514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc130861-b565-4a34-9795-2d169aadd97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.727778 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc130861-b565-4a34-9795-2d169aadd97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3930be7d-97b3-4105-a33c-27fcb695752b', 'volume_name': 'volume-3930be7d-97b3-4105-a33c-27fcb695752b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.730091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c845ef-7cba-4390-ba79-bc8aaa370216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.732245 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c845ef-7cba-4390-ba79-bc8aaa370216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.734479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ca45da-9522-40bc-8bfa-a9c65943507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.748324 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Volume 3930be7d-97b3-4105-a33c-27fcb695752b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3930be7d-97b3-4105-a33c-27fcb695752b', 'volume_size': 1} Nov 27 21:07:15.748723 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] creating volume 'volume-3930be7d-97b3-4105-a33c-27fcb695752b' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:15.749704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:15.798338 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:15.799830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:15.801961 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ca45da-9522-40bc-8bfa-a9c65943507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3930be7d-97b3-4105-a33c-27fcb695752b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.804222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e0ea02-f4a8-4f16-bb65-445a84658f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:15.812819 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Volume volume-3930be7d-97b3-4105-a33c-27fcb695752b (3930be7d-97b3-4105-a33c-27fcb695752b): created successfully Nov 27 21:07:15.814906 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e0ea02-f4a8-4f16-bb65-445a84658f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:15.817906 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (4ec11d9c-816a-4622-a4ab-a53c55172eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:15.825782 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f21f2e9b-a166-4371-b47e-fbeab0589d1c tempest-GroupsTest-1500057733 None] Created volume successfully. Nov 27 21:07:16.391287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:16.395896 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:16.396402 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:16.409166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Flow 'volume_create_manager' (47768aff-1b6b-47ca-9b73-165f61ccd218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:16.412562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8501ef-9a03-4724-92c8-6837a66f4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.418791 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:16.435727 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8501ef-9a03-4724-92c8-6837a66f4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1872162333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4558af09-ac74-43cf-9df1-40c54ef24649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b756ba4e580446980b973ad0b42b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:16Z,use_quota=True,user_id='67ee436ffe774a1eb71cdb910112c7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.438571 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f5c49-4a9f-4a6f-813d-09bbf8d59245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.453568 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f5c49-4a9f-4a6f-813d-09bbf8d59245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.453568 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a252ffa-98fe-46a6-b9af-4af66598ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.453568 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a252ffa-98fe-46a6-b9af-4af66598ae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4558af09-ac74-43cf-9df1-40c54ef24649', 'volume_name': 'volume-4558af09-ac74-43cf-9df1-40c54ef24649', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.455841 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f539c-1a66-45ce-bf22-b1efad44f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.458027 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0f539c-1a66-45ce-bf22-b1efad44f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.463205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b7769-7a37-437c-81e0-36f1e296a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.463205 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume 4558af09-ac74-43cf-9df1-40c54ef24649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4558af09-ac74-43cf-9df1-40c54ef24649', 'volume_size': 1} Nov 27 21:07:16.463205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] creating volume 'volume-4558af09-ac74-43cf-9df1-40c54ef24649' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:16.463205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:16.526535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:16.526995 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:16.529540 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b7769-7a37-437c-81e0-36f1e296a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4558af09-ac74-43cf-9df1-40c54ef24649', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.532746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec5dd80-c898-412e-acba-7f79b38fd1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:16.545661 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume volume-4558af09-ac74-43cf-9df1-40c54ef24649 (4558af09-ac74-43cf-9df1-40c54ef24649): created successfully Nov 27 21:07:16.548234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec5dd80-c898-412e-acba-7f79b38fd1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:16.553189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Flow 'volume_create_manager' (47768aff-1b6b-47ca-9b73-165f61ccd218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:16.567729 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0e505d22-048d-462f-a100-e72e5efebe66 tempest-AttachVolumeShelveTestJSON-1238752384 None] Created volume successfully. Nov 27 21:07:17.094091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:17.098220 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:17.098765 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:17.113148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (baf3c27b-163b-4e3e-9047-1cb20180f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:17.116847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2deb76a5-18ed-49c3-8872-f4f59c4c4139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.123225 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:17.136904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2deb76a5-18ed-49c3-8872-f4f59c4c4139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1662774844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1a596f2-65ac-4df4-b0dd-13cc738464c8,host='ncdv-master-1@ceph#ceph',id=2589d0af-cc12-4270-9e36-3efed34cb77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01631e590ebe4902a5848693921c36c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:17Z,use_quota=True,user_id='b4a0ffea69144229864909cd516d0be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c70fdec8-4fad-424b-bc98-560fcb337888),volume_type_id=c70fdec8-4fad-424b-bc98-560fcb337888)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.139507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24de87ff-5d4a-4e87-b2a4-c0fd1501e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.141651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24de87ff-5d4a-4e87-b2a4-c0fd1501e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.144111 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34119eb7-6959-4cbd-b08a-46af249117dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.146330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34119eb7-6959-4cbd-b08a-46af249117dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2589d0af-cc12-4270-9e36-3efed34cb77e', 'volume_name': 'volume-2589d0af-cc12-4270-9e36-3efed34cb77e', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.148661 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e9df00-c79e-4adf-8443-ba93b6c03f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.150791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e9df00-c79e-4adf-8443-ba93b6c03f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.153036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56b822c-9a6a-4822-9b6f-b672cd5296f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.166862 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Volume 2589d0af-cc12-4270-9e36-3efed34cb77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2589d0af-cc12-4270-9e36-3efed34cb77e', 'volume_size': 1} Nov 27 21:07:17.167278 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] creating volume 'volume-2589d0af-cc12-4270-9e36-3efed34cb77e' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:17.168262 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:17.218376 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:17.218709 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:17.221337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56b822c-9a6a-4822-9b6f-b672cd5296f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2589d0af-cc12-4270-9e36-3efed34cb77e', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.223551 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9fe914-cf12-42d0-b8f4-acaa3db998b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.231963 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Volume volume-2589d0af-cc12-4270-9e36-3efed34cb77e (2589d0af-cc12-4270-9e36-3efed34cb77e): created successfully Nov 27 21:07:17.233742 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9fe914-cf12-42d0-b8f4-acaa3db998b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.237348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Flow 'volume_create_manager' (baf3c27b-163b-4e3e-9047-1cb20180f380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:17.244298 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-abe88804-0b72-48f4-9e0c-b8b42b8f0688 tempest-GroupsTest-1500057733 None] Created volume successfully. Nov 27 21:07:17.909684 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:17.912883 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:17.913326 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:17.924890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Flow 'volume_create_manager' (eb9ff2f0-3651-4d5d-af5c-860bfbad9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:17.928405 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b20a1-2553-45d1-8324-84422fdc2b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.934323 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:17.946703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b20a1-2553-45d1-8324-84422fdc2b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2069126157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80247849-0ed6-4731-864e-e9795296e543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcfaa0229934ca2881bd510e1a2aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:18Z,use_quota=True,user_id='0b931665afff4f99b4804188e9ae1438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.949301 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888495cf-732c-4174-821b-61270fa6689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.951460 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888495cf-732c-4174-821b-61270fa6689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.953876 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6158ec8-2bb5-45b1-9e89-672c99be6f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.956833 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6158ec8-2bb5-45b1-9e89-672c99be6f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80247849-0ed6-4731-864e-e9795296e543', 'volume_name': 'volume-80247849-0ed6-4731-864e-e9795296e543', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.959593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c467a5b7-36bf-44f5-9b25-5698952e3c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.961688 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c467a5b7-36bf-44f5-9b25-5698952e3c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:17.963913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb64c99-63e1-4fff-bd25-426841b0df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:17.964682 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume 80247849-0ed6-4731-864e-e9795296e543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80247849-0ed6-4731-864e-e9795296e543', 'volume_size': 1} Nov 27 21:07:17.965070 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] creating volume 'volume-80247849-0ed6-4731-864e-e9795296e543' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:17.966018 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:18.023372 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:18.023754 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:18.025846 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb64c99-63e1-4fff-bd25-426841b0df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80247849-0ed6-4731-864e-e9795296e543', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:18.028040 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7651e0f-99a0-4355-8528-08a259691e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:18.036095 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume volume-80247849-0ed6-4731-864e-e9795296e543 (80247849-0ed6-4731-864e-e9795296e543): created successfully Nov 27 21:07:18.038154 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7651e0f-99a0-4355-8528-08a259691e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:18.041250 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Flow 'volume_create_manager' (eb9ff2f0-3651-4d5d-af5c-860bfbad9245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:18.050180 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ffd48a30-01e5-469a-9e0a-75c8a99358a3 tempest-ServerRescueNegativeTestJSON-609742415 None] Created volume successfully. Nov 27 21:07:18.300301 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-409a6553-5014-4b96-a7e4-03dfac8d3373 tempest-GroupsTest-1500057733 None] Update group completed successfully. Nov 27 21:07:18.836603 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-e3f29e81-0b6c-44f9-b61f-90d6466cc73d tempest-VolumesActionsTest-24419802 None] Running cmd (subprocess): rbd export --pool volumes volume-6032ba5a-c1ae-4962-92c0-250d5379a789 /opt/stack/data/cinder/conversion/volume-6032ba5a-c1ae-4962-92c0-250d5379a789-54573102-4490-4267-8f4b-7e6f2d61a02b --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:07:19.479069 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-e3f29e81-0b6c-44f9-b61f-90d6466cc73d tempest-VolumesActionsTest-24419802 None] CMD "rbd export --pool volumes volume-6032ba5a-c1ae-4962-92c0-250d5379a789 /opt/stack/data/cinder/conversion/volume-6032ba5a-c1ae-4962-92c0-250d5379a789-54573102-4490-4267-8f4b-7e6f2d61a02b --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:07:19.490513 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.image_utils [None req-e3f29e81-0b6c-44f9-b61f-90d6466cc73d tempest-VolumesActionsTest-24419802 None] 54573102-4490-4267-8f4b-7e6f2d61a02b was raw, no need to convert to raw {{(pid=129088) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Nov 27 21:07:19.696570 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d9298ce0-0298-45e4-b51f-c1fd87ae8c4b tempest-GroupsTest-1500057733 None] Update group completed successfully. Nov 27 21:07:19.733788 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 req-8647770b-c26c-4ec7-8dd0-e7befc578617 tempest-ServerRescueNegativeTestJSON-609742415 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:07:20.456351 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 req-8647770b-c26c-4ec7-8dd0-e7befc578617 tempest-ServerRescueNegativeTestJSON-609742415 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:07:20.457073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 req-8647770b-c26c-4ec7-8dd0-e7befc578617 tempest-ServerRescueNegativeTestJSON-609742415 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-80247849-0ed6-4731-864e-e9795296e543', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '80247849-0ed6-4731-864e-e9795296e543', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:07:20.486850 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 req-8647770b-c26c-4ec7-8dd0-e7befc578617 tempest-ServerRescueNegativeTestJSON-609742415 None] Connection info returned from driver {'name': 'volumes/volume-80247849-0ed6-4731-864e-e9795296e543', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '80247849-0ed6-4731-864e-e9795296e543', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '48309839-c90a-4ee8-8fba-d46a2ff9d75e'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:07:20.540880 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 req-8647770b-c26c-4ec7-8dd0-e7befc578617 tempest-ServerRescueNegativeTestJSON-609742415 None] attachment_update completed successfully. Nov 27 21:07:21.170103 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:21.237206 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:21.237672 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Volume volume-2589d0af-cc12-4270-9e36-3efed34cb77e is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:21.243549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] deleting rbd volume volume-2589d0af-cc12-4270-9e36-3efed34cb77e {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:21.500252 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:21.558627 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:21.559648 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Volume volume-3930be7d-97b3-4105-a33c-27fcb695752b is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:21.564786 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] deleting rbd volume volume-3930be7d-97b3-4105-a33c-27fcb695752b {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:21.941915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Created reservations ['2439429d-a6cf-4f2f-bb8f-44c600817a89'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:21.961887 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1334857680 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1334857680, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:21.962745 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1334857680 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1334857680, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:07:21.980145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Created reservations ['8215e1d0-d77e-4055-82a4-4cd2dd6e1c16', '941ae7a0-e304-4b88-b71a-85250dca2805', '5765fc30-b1b8-41e6-8f43-91474ff90331', '9ca2db4f-1c78-4a03-87fa-669b60ead0c5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:22.072434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Created reservations ['3531b3fd-6758-4f66-a525-5d20894bd777', 'f8980dbc-30e5-489a-86a1-2a1268c9e147', '3a013973-c584-460e-a7a9-0654581ca4a7', '941a692b-76f7-49a6-83a4-3d171b070f55'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:22.172026 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:22.198294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:22.222454 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:22.226583 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c55583cd-956e-42cc-a2be-68d88dc07e5a tempest-GroupsTest-1500057733 None] Delete group completed successfully. Nov 27 21:07:41.190727 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-e3f29e81-0b6c-44f9-b61f-90d6466cc73d tempest-VolumesActionsTest-24419802 None] Uploaded volume to glance image-id: 54573102-4490-4267-8f4b-7e6f2d61a02b. {{(pid=129088) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Nov 27 21:07:41.221935 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e3f29e81-0b6c-44f9-b61f-90d6466cc73d tempest-VolumesActionsTest-24419802 None] Copy volume to image completed successfully. Nov 27 21:07:43.376811 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:43.462376 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:43.572590 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:43.573311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Volume volume-6032ba5a-c1ae-4962-92c0-250d5379a789 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:43.580960 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] deleting rbd volume volume-6032ba5a-c1ae-4962-92c0-250d5379a789 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:43.993658 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Created reservations ['6cb855b8-5a67-4b9f-9b2f-281610491f9e', '1fdb2d91-e5c2-436c-a6cf-e7a6516f6900', '3f3d6ee1-fc04-4193-a5c7-722ede4de349', 'c86130a4-1778-407f-9af1-b76826de8240'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:44.061255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:44.158359 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:44.208842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:44.222000 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Deleted volume successfully. Nov 27 21:07:44.237753 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:44.241457 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:44.242528 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:44.261594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (b33d11a5-6aeb-45ea-97d4-a174af698ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:44.265270 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4f2623-db00-4335-a851-4a24f0f6b475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:44.274417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c8a323d0-9fe3-4329-bc95-ccea3d95e24d tempest-VolumesActionsTest-24419802 None] Lock "b'cinder-6032ba5a-c1ae-4962-92c0-250d5379a789-delete_volume'" released by "delete_volume" :: held 0.898s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:44.277298 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:44.295706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4f2623-db00-4335-a851-4a24f0f6b475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1057759825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4709f4b9-e86f-4b27-93c5-7fd13d43aac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bcfde0f704cce95e3dd3f22c1dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:44Z,use_quota=True,user_id='0daa9eae13b348b38a70707bf25f4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:44.299394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842629ae-910a-479a-9289-f53a96b37248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:44.301823 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842629ae-910a-479a-9289-f53a96b37248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:44.304689 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c034103f-8194-4561-abf5-ee23a82cb31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:44.425273 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c034103f-8194-4561-abf5-ee23a82cb31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'volume_name': 'volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:44.427784 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f478ce-da66-4685-b8cf-80afa34b792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:44.431162 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f478ce-da66-4685-b8cf-80afa34b792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:44.433991 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8efd5c5-60ff-4d00-b347-bc66f46854e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:44.435119 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Volume 4709f4b9-e86f-4b27-93c5-7fd13d43aac2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:07:44.436464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Cloning 4709f4b9-e86f-4b27-93c5-7fd13d43aac2 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:07:44.465135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:44.475717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 7, 44, 470632)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:07:44.476701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:07:44.477337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:07:44.482998 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:44.485705 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:07:44.493463 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 7, 44, 490399)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:07:44.494375 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:07:44.495403 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:07:44.510578 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:44.605385 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] creating snapshot='volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:07:45.606571 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2.clone_snap' to 'volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:07:45.856314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:45.857734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:45.858303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:45.898859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:07:45.899783 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Marking volume 4709f4b9-e86f-4b27-93c5-7fd13d43aac2 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:07:45.917290 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 4709f4b9-e86f-4b27-93c5-7fd13d43aac2. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:07:45.919361 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Creating volume glance metadata for volume 4709f4b9-e86f-4b27-93c5-7fd13d43aac2 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:07:46.036356 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8efd5c5-60ff-4d00-b347-bc66f46854e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.040934 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cabfc49-0e00-40f4-911d-1e23d50b8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.053694 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Volume volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2 (4709f4b9-e86f-4b27-93c5-7fd13d43aac2): created successfully Nov 27 21:07:46.057317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cabfc49-0e00-40f4-911d-1e23d50b8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.063386 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (b33d11a5-6aeb-45ea-97d4-a174af698ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:46.081871 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7ab3eb84-9eee-4401-acfa-a437a832c581 tempest-VolumesCloneTest-488427999 None] Created volume successfully. Nov 27 21:07:46.705692 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:46.710318 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:46.710870 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:46.737406 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (88aa99e3-fc36-4259-8bf7-c8d712e2dbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:46.741949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0673ec-ff1d-4a35-9dc3-1a9d363edb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.749006 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:46.762515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0673ec-ff1d-4a35-9dc3-1a9d363edb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2123446849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bcfde0f704cce95e3dd3f22c1dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4709f4b9-e86f-4b27-93c5-7fd13d43aac2,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:47Z,use_quota=True,user_id='0daa9eae13b348b38a70707bf25f4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.766694 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825b74a3-5fed-4670-a370-e73aa583d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.768989 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825b74a3-5fed-4670-a370-e73aa583d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.771489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0ea30-3438-46d2-8a30-d5772c2be956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.787033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0ea30-3438-46d2-8a30-d5772c2be956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11', 'volume_name': 'volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11', 'volume_size': 1, 'source_volid': '4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.789478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa627a12-c430-4686-acf2-db726bb64a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.792439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa627a12-c430-4686-acf2-db726bb64a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:46.794922 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49219356-1731-46f6-b1aa-f77d4bd70ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:46.796009 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Volume 9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11', 'volume_size': 1, 'source_volid': '4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'source_volstatus': 'available'} Nov 27 21:07:46.810790 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:46.948519 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] creating snapshot='volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:07:47.582222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] cloning 'volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2@volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11.clone_snap' to 'volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:07:47.797949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:47.799885 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:47.800567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:47.840494 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:07:47.841362 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Marking volume 9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:07:47.851049 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Copying metadata from source volume 4709f4b9-e86f-4b27-93c5-7fd13d43aac2 to 9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Nov 27 21:07:47.885496 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49219356-1731-46f6-b1aa-f77d4bd70ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11', 'volume_size': 1, 'source_volid': '4709f4b9-e86f-4b27-93c5-7fd13d43aac2', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:47.888065 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a4509e-6bcf-4023-8a5c-d5a77c9b099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:47.899562 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Volume volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11 (9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11): created successfully Nov 27 21:07:47.901494 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a4509e-6bcf-4023-8a5c-d5a77c9b099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:47.904586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (88aa99e3-fc36-4259-8bf7-c8d712e2dbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:47.918398 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8bf06a74-34a9-4217-84aa-2939081fcd43 tempest-VolumesCloneTest-488427999 None] Created volume successfully. Nov 27 21:07:48.198248 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-df1bc79d-0663-46cd-9051-16aa48255665 req-6f7c968d-da2b-49d9-b4fc-39e2299f9049 tempest-ServerRescueNegativeTestJSON-609742415 None] Terminate volume connection completed successfully. Nov 27 21:07:48.198771 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-df1bc79d-0663-46cd-9051-16aa48255665 req-6f7c968d-da2b-49d9-b4fc-39e2299f9049 tempest-ServerRescueNegativeTestJSON-609742415 None] Deleting attachment 48309839-c90a-4ee8-8fba-d46a2ff9d75e. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:07:48.940341 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Lock "b'cinder-80247849-0ed6-4731-864e-e9795296e543-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:49.046322 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:49.132038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:49.132685 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Volume volume-80247849-0ed6-4731-864e-e9795296e543 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:49.139899 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] deleting rbd volume volume-80247849-0ed6-4731-864e-e9795296e543 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:49.280647 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:49.284369 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:49.284822 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:49.297442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (0b90974d-371d-4a54-9215-f1e479945472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:49.302464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683d8447-e342-4a00-a785-54eb308a8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.310700 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:49.327208 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683d8447-e342-4a00-a785-54eb308a8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1898308938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b1329e3f-6606-4434-8e15-59ff86428a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bcfde0f704cce95e3dd3f22c1dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:49Z,use_quota=True,user_id='0daa9eae13b348b38a70707bf25f4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.330429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0bcf1b-5541-4256-8f3c-408ffb62bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.333339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0bcf1b-5541-4256-8f3c-408ffb62bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.336091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c483882-9d58-44cc-8c02-b82d8ffbfb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.338593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c483882-9d58-44cc-8c02-b82d8ffbfb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1329e3f-6606-4434-8e15-59ff86428a83', 'volume_name': 'volume-b1329e3f-6606-4434-8e15-59ff86428a83', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.341184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a71107a-8624-4f9e-bdd9-95a9205ffe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.343775 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a71107a-8624-4f9e-bdd9-95a9205ffe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.346044 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd8fd5c-7f9d-47da-aff7-495b3f9834a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.346911 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Volume b1329e3f-6606-4434-8e15-59ff86428a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1329e3f-6606-4434-8e15-59ff86428a83', 'volume_size': 1} Nov 27 21:07:49.347384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] creating volume 'volume-b1329e3f-6606-4434-8e15-59ff86428a83' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:07:49.348600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:49.463664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:49.464134 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:49.466794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd8fd5c-7f9d-47da-aff7-495b3f9834a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1329e3f-6606-4434-8e15-59ff86428a83', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.470663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078420ae-dd20-4c98-8d1f-b54fc2fc6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:49.495867 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Volume volume-b1329e3f-6606-4434-8e15-59ff86428a83 (b1329e3f-6606-4434-8e15-59ff86428a83): created successfully Nov 27 21:07:49.497871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078420ae-dd20-4c98-8d1f-b54fc2fc6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:49.501530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (0b90974d-371d-4a54-9215-f1e479945472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:49.514462 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-803fb77f-7aa9-4d81-8e1a-fdd405293c46 tempest-VolumesCloneTest-488427999 None] Created volume successfully. Nov 27 21:07:49.527933 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Created reservations ['a4feb82f-f637-4a89-afc0-7679c8925912', 'affe0465-2fab-4583-b205-a84d71b6ca30', 'db973b3c-ff04-4790-acd7-54a87c028bf0', '2a2350e6-8dfb-4856-8926-0b0a4ecba91f'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:49.579859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:49.628411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:49.701975 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:49.707237 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Deleted volume successfully. Nov 27 21:07:49.727079 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-572f2189-ca82-4bf4-bdfa-e9a7c7dcf1b1 tempest-ServerRescueNegativeTestJSON-609742415 None] Lock "b'cinder-80247849-0ed6-4731-864e-e9795296e543-delete_volume'" released by "delete_volume" :: held 0.787s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:50.160918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Lock "b'cinder-b00e3144-c126-4707-91c1-6b49f923c0fd-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:50.240004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:50.351298 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:50.351823 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Volume volume-b00e3144-c126-4707-91c1-6b49f923c0fd is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:50.360758 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] deleting rbd volume volume-b00e3144-c126-4707-91c1-6b49f923c0fd {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:50.771624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Created reservations ['6c2df9a5-100e-4200-8539-c50781b9fb02', 'a59fd8a2-1b7c-404b-a9ed-92c9684c751f', 'df25456c-b7ca-44ec-b88a-d06b0ce8084b', 'f790ba40-0337-4272-bacf-d67b45e685cb'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:50.861387 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:50.945671 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:51.037810 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:51.049949 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Deleted volume successfully. Nov 27 21:07:51.066721 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e18de3d6-7b3b-403c-938e-f551d90d5dfa tempest-ServerRescueNegativeTestJSON-609742415 None] Lock "b'cinder-b00e3144-c126-4707-91c1-6b49f923c0fd-delete_volume'" released by "delete_volume" :: held 0.906s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:51.071760 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:07:51.075998 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:07:51.076648 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:07:51.100972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (f17a5130-b855-42f9-8d45-978bc9c0bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:51.104928 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0786975-8065-4d91-acad-c5a3d3d109ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:51.115754 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:07:51.139082 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0786975-8065-4d91-acad-c5a3d3d109ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1101743261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0020a7ee-486f-4ea1-b020-a8f7f25a368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3bcfde0f704cce95e3dd3f22c1dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:07:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b1329e3f-6606-4434-8e15-59ff86428a83,status='creating',terminated_at=None,updated_at=2021-11-27T21:07:51Z,use_quota=True,user_id='0daa9eae13b348b38a70707bf25f4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:51.141880 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516a0bdd-bc39-45f4-bde3-d3e4afcd5e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:51.144116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516a0bdd-bc39-45f4-bde3-d3e4afcd5e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:51.151375 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d416e-07ea-49cc-998d-0bf3f5506bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:51.170897 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d416e-07ea-49cc-998d-0bf3f5506bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0020a7ee-486f-4ea1-b020-a8f7f25a368c', 'volume_name': 'volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c', 'volume_size': 2, 'source_volid': 'b1329e3f-6606-4434-8e15-59ff86428a83', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:51.173874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4724adb7-9f00-4c27-9af4-e98e6823b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:51.180436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4724adb7-9f00-4c27-9af4-e98e6823b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:51.182593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eee2f8-b754-4009-8f5a-9bc04bbbd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:51.183466 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Volume 0020a7ee-486f-4ea1-b020-a8f7f25a368c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c', 'volume_size': 2, 'source_volid': 'b1329e3f-6606-4434-8e15-59ff86428a83', 'source_volstatus': 'available'} Nov 27 21:07:51.199175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:51.288583 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] creating snapshot='volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:07:51.576991 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] cloning 'volume-b1329e3f-6606-4434-8e15-59ff86428a83@volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c.clone_snap' to 'volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:07:51.744225 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Volume volume-b1329e3f-6606-4434-8e15-59ff86428a83 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:51.748082 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:07:51.749393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:07:51.785641 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] resize volume 'volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c' from 1 to 2 {{(pid=129088) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Nov 27 21:07:51.786443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:52.038800 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:07:52.042512 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eee2f8-b754-4009-8f5a-9bc04bbbd181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c', 'volume_size': 2, 'source_volid': 'b1329e3f-6606-4434-8e15-59ff86428a83', 'source_volstatus': 'available'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:52.046782 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c9ead0-65bf-4cf7-9d1e-6db3f9e1c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:07:52.063407 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Volume volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c (0020a7ee-486f-4ea1-b020-a8f7f25a368c): created successfully Nov 27 21:07:52.067390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c9ead0-65bf-4cf7-9d1e-6db3f9e1c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:07:52.071977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Flow 'volume_create_manager' (f17a5130-b855-42f9-8d45-978bc9c0bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:07:52.090984 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-823667c4-6b32-443d-905f-4e238aeb71a7 tempest-VolumesCloneTest-488427999 None] Created volume successfully. Nov 27 21:07:52.987489 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-547ba77f-362d-4e20-88c0-b88b26a2c60f req-dd8bbabf-d350-4984-bd92-c1242bbafbe5 tempest-AttachVolumeShelveTestJSON-1238752384 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:07:53.276888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-0020a7ee-486f-4ea1-b020-a8f7f25a368c-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:53.340271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:53.437511 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:53.454215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] deleting rbd volume volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:53.739078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:07:53.772569 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Volume volume-b1329e3f-6606-4434-8e15-59ff86428a83 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:53.773493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] deleting parent snapshot volume-0020a7ee-486f-4ea1-b020-a8f7f25a368c.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:07:53.983938 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-547ba77f-362d-4e20-88c0-b88b26a2c60f req-dd8bbabf-d350-4984-bd92-c1242bbafbe5 tempest-AttachVolumeShelveTestJSON-1238752384 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.995s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:07:53.993331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-547ba77f-362d-4e20-88c0-b88b26a2c60f req-dd8bbabf-d350-4984-bd92-c1242bbafbe5 tempest-AttachVolumeShelveTestJSON-1238752384 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4558af09-ac74-43cf-9df1-40c54ef24649', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '4558af09-ac74-43cf-9df1-40c54ef24649', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:07:54.046575 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Created reservations ['f78a3be2-76f8-4fa1-8073-2bf600cd1b19', 'b2930584-3666-4702-bd17-102e625afaaa', 'd9e185c2-bf64-4b4f-85b1-fa5bd0cae0c9', '565af9e7-78d6-41e0-a974-d95fc54052cc'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:54.058296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-547ba77f-362d-4e20-88c0-b88b26a2c60f req-dd8bbabf-d350-4984-bd92-c1242bbafbe5 tempest-AttachVolumeShelveTestJSON-1238752384 None] Connection info returned from driver {'name': 'volumes/volume-4558af09-ac74-43cf-9df1-40c54ef24649', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4558af09-ac74-43cf-9df1-40c54ef24649', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fba06e10-e9e7-417e-ab42-b89b496c96f8'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:07:54.122318 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-547ba77f-362d-4e20-88c0-b88b26a2c60f req-dd8bbabf-d350-4984-bd92-c1242bbafbe5 tempest-AttachVolumeShelveTestJSON-1238752384 None] attachment_update completed successfully. Nov 27 21:07:54.138703 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:54.193945 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:54.262221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:54.268838 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Deleted volume successfully. Nov 27 21:07:54.287204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d2f122b9-8de5-4a9c-9e1d-a7b889b1ad00 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-0020a7ee-486f-4ea1-b020-a8f7f25a368c-delete_volume'" released by "delete_volume" :: held 1.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:54.506998 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-b1329e3f-6606-4434-8e15-59ff86428a83-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:54.584909 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:54.644422 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:54.645027 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Volume volume-b1329e3f-6606-4434-8e15-59ff86428a83 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:07:54.653870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] deleting rbd volume volume-b1329e3f-6606-4434-8e15-59ff86428a83 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:55.067392 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Created reservations ['0aab3a86-9a9c-40ea-8789-0a75416af50c', '33408e9e-dadc-4a06-b94a-5578eff0b8ef', '00d217b8-f093-4016-bed3-c53d3be31538', '4c5cd41e-e8df-42c6-a713-28505499ff7e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:55.122767 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:55.156037 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:55.186990 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:55.192047 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Deleted volume successfully. Nov 27 21:07:55.205116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-bd1d89fe-02de-4241-bacb-1ea942e8e1e6 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-b1329e3f-6606-4434-8e15-59ff86428a83-delete_volume'" released by "delete_volume" :: held 0.698s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:55.693380 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:55.732676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:55.872670 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:55.888182 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] deleting rbd volume volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:56.234308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:07:56.298192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] deleting parent snapshot volume-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:07:57.089287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] Created reservations ['fd782440-f352-43a4-a0d0-0dcd0a643fdf', 'a68f3da9-811a-4d44-90a2-08d5885f5681', '0dc0d516-018b-45a4-9c56-4e968348ca90', 'fdafb0f9-5cf6-4a89-9416-966db184a0e1'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:57.185708 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:57.272968 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:57.330027 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:57.342464 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] Deleted volume successfully. Nov 27 21:07:57.363347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e2c52495-de00-4f0b-83d1-37e91cdf6ff0 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-9ec40ecc-1bbe-4ae5-b90a-0eb52004cb11-delete_volume'" released by "delete_volume" :: held 1.673s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:07:57.908316 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:07:57.908731 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:57.974043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:58.045040 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:58.074303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-4709f4b9-e86f-4b27-93c5-7fd13d43aac2-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:07:58.134202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:58.247297 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:07:58.261811 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] deleting rbd volume volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:07:58.603607 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:07:58.660758 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] deleting parent snapshot volume-4709f4b9-e86f-4b27-93c5-7fd13d43aac2.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:07:59.212470 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] Created reservations ['5248cea1-bab0-43cd-b385-6c16b33b456a', '8863652f-6f50-4789-a0f0-997a364b7fef', '6005cd19-08d7-4476-97a8-166c193e5506', '9477d153-57d5-4603-8e56-e8cb6d23defe'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:07:59.274427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:59.357911 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:07:59.436055 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:07:59.462467 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] Deleted volume successfully. Nov 27 21:07:59.484814 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e7762c8a-8705-4ba7-8ac5-6a353ee47675 tempest-VolumesCloneTest-488427999 None] Lock "b'cinder-4709f4b9-e86f-4b27-93c5-7fd13d43aac2-delete_volume'" released by "delete_volume" :: held 1.409s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:08:02.963679 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:08:02.967359 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:08:02.967852 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:08:02.981048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Flow 'volume_create_manager' (67fbcea7-e68f-4bf4-934b-01c573e6227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:08:02.984757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87795431-07bc-4f84-8b03-25011f29b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:02.991704 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:08:03.006234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87795431-07bc-4f84-8b03-25011f29b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-558158194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c053fd9-057f-4e8c-a650-0003cdf22957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14c416fb81f4b1dbff2aa82e2323988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:08:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:08:03Z,use_quota=True,user_id='267a528bdc2d4279b338859db42b5d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.008984 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44e013f-82bb-41f6-bbcd-cf3b1c196a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:03.011609 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44e013f-82bb-41f6-bbcd-cf3b1c196a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.014173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1dd0fc-a555-4e7d-84d7-102a3eba4257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:03.017171 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1dd0fc-a555-4e7d-84d7-102a3eba4257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c053fd9-057f-4e8c-a650-0003cdf22957', 'volume_name': 'volume-2c053fd9-057f-4e8c-a650-0003cdf22957', 'volume_size': 2}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.019651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a32cd70-f97e-4a76-9705-232ce89348e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:03.021922 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a32cd70-f97e-4a76-9705-232ce89348e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.024547 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7c0c75-6d9e-4965-9eb4-bfd68a6a1b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:03.025342 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Volume 2c053fd9-057f-4e8c-a650-0003cdf22957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c053fd9-057f-4e8c-a650-0003cdf22957', 'volume_size': 2} Nov 27 21:08:03.025752 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] creating volume 'volume-2c053fd9-057f-4e8c-a650-0003cdf22957' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:08:03.026745 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:03.075244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:08:03.075658 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:08:03.077650 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7c0c75-6d9e-4965-9eb4-bfd68a6a1b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c053fd9-057f-4e8c-a650-0003cdf22957', 'volume_size': 2}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.079871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed641a57-01ea-4108-8ca9-c8240ca3be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:08:03.090789 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Volume volume-2c053fd9-057f-4e8c-a650-0003cdf22957 (2c053fd9-057f-4e8c-a650-0003cdf22957): created successfully Nov 27 21:08:03.092869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed641a57-01ea-4108-8ca9-c8240ca3be02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:08:03.096055 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Flow 'volume_create_manager' (67fbcea7-e68f-4bf4-934b-01c573e6227d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:08:03.106818 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8f070d52-ea83-470d-b46d-6711555a82d3 tempest-VolumesCloneNegativeTest-112231606 None] Created volume successfully. Nov 27 21:08:04.165033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Lock "b'cinder-2c053fd9-057f-4e8c-a650-0003cdf22957-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:08:04.207931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:04.278621 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:08:04.279129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Volume volume-2c053fd9-057f-4e8c-a650-0003cdf22957 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:08:04.290860 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] deleting rbd volume volume-2c053fd9-057f-4e8c-a650-0003cdf22957 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:08:04.611141 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Created reservations ['f27df712-13dc-419d-88f9-a0fae0eb3046', '97b3259c-176e-49ab-9e62-dfc6576c2002', '0551418b-5708-4232-8f16-dd7fa2a17ac2', 'ccc2f84d-31e9-4f76-8ebe-a693ed713a33'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:08:04.683023 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:04.727787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:04.772638 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:08:04.778387 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Deleted volume successfully. Nov 27 21:08:04.793989 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-09aa6bea-26f5-46f1-bb5d-70c259881928 tempest-VolumesCloneNegativeTest-112231606 None] Lock "b'cinder-2c053fd9-057f-4e8c-a650-0003cdf22957-delete_volume'" released by "delete_volume" :: held 0.629s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:08:39.098800 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-b563ae63-e0ba-4ffd-b7ae-ba3ba3f2ed61 tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 21:08:39.099543 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-b563ae63-e0ba-4ffd-b7ae-ba3ba3f2ed61 tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment 7079ef06-7b47-4c5c-83c6-0bb37c31a743. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:08:39.196358 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-122482a5-fb55-4fef-bc12-aefdb9443f57 tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 21:08:39.196776 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-122482a5-fb55-4fef-bc12-aefdb9443f57 tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment 6bb5b733-5858-4b8a-98bb-7850619d4d85. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:08:39.332865 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-6fd611ef-a484-459d-bd8e-07ba92d5429b tempest-TaggedBootDevicesTest-1441186917 None] Terminate volume connection completed successfully. Nov 27 21:08:39.348426 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 req-6fd611ef-a484-459d-bd8e-07ba92d5429b tempest-TaggedBootDevicesTest-1441186917 None] Deleting attachment 393d9f22-9d95-424b-8723-369b234af8ba. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:08:44.439556 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-d68e4828-a000-482f-90e9-83e87b933855-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:08:44.472645 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:44.521586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:08:44.522013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-d68e4828-a000-482f-90e9-83e87b933855 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:08:44.527797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] deleting rbd volume volume-d68e4828-a000-482f-90e9-83e87b933855 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:08:44.743138 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Created reservations ['31d6c7e6-30d8-47aa-a554-910b03c2ce97', 'd32af794-a671-47ad-8d27-94c822e1774f', '129aaac0-c350-4c26-ad8e-dac82e6ba71a', 'c3a80a65-ed7c-4bc8-8d1c-f9baafba1e05'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:08:44.794176 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:44.840014 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:44.887981 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:08:44.899824 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Deleted volume successfully. Nov 27 21:08:44.915626 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7b1f52c2-898a-47b2-8839-7e18f43ec11c tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-d68e4828-a000-482f-90e9-83e87b933855-delete_volume'" released by "delete_volume" :: held 0.476s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:08:45.576931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-10ddafcd-c9e0-437c-8d6e-29009b4bedca-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:08:45.607825 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:45.647365 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:08:45.647842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Volume volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:08:45.652972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] deleting rbd volume volume-10ddafcd-c9e0-437c-8d6e-29009b4bedca {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:08:45.880944 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Created reservations ['5988995a-e605-464b-a01b-a96849f3af14', 'e7955d17-6d85-4121-b1ad-9d8a79dec1a6', '9d34d2da-39b0-4058-9595-c48457313ccf', '6aa59c32-5845-4396-abcf-2adcf9f36f0b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:08:45.921779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:45.950331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:45.983612 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:08:45.991140 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Deleted volume successfully. Nov 27 21:08:46.004812 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-07c6ff85-54c2-45a0-9795-d03b030db37f tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-10ddafcd-c9e0-437c-8d6e-29009b4bedca-delete_volume'" released by "delete_volume" :: held 0.428s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:08:46.716102 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-caa38af6-5178-4b65-9a06-d11b9f7b1114-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:08:46.752883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:46.838026 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:08:46.845418 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] deleting rbd volume volume-caa38af6-5178-4b65-9a06-d11b9f7b1114 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:08:47.078148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:08:47.116327 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] deleting parent snapshot volume-caa38af6-5178-4b65-9a06-d11b9f7b1114.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:08:47.363450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] Created reservations ['49d02d2e-904c-49af-9f56-63b11e8ce2a2', '20536989-2c5e-406e-9dd0-8071ec1f2aa8', '4b52cad5-84d0-474b-b4e0-ced906de7e50', 'a8de2299-21e5-4998-8b54-d8f0a5392875'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:08:47.460558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:47.518198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:47.560193 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:08:47.565009 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] Deleted volume successfully. Nov 27 21:08:47.581221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d2db56e-d983-47f1-8cea-776aa5c9c4f6 tempest-TaggedBootDevicesTest-1441186917 None] Lock "b'cinder-caa38af6-5178-4b65-9a06-d11b9f7b1114-delete_volume'" released by "delete_volume" :: held 0.865s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:08:51.349492 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4bb50cba-0402-424b-b091-7da0a2d3f51b req-396b9475-f31e-4862-854f-dac55105a6b1 tempest-AttachVolumeShelveTestJSON-1238752384 None] Terminate volume connection completed successfully. Nov 27 21:08:51.350069 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4bb50cba-0402-424b-b091-7da0a2d3f51b req-396b9475-f31e-4862-854f-dac55105a6b1 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deleting attachment fba06e10-e9e7-417e-ab42-b89b496c96f8. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:08:57.911243 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:08:57.913317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:57.963460 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:08:57.994952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:09:57.910603 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:09:57.912033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:09:57.949956 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:09:58.019282 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:10:46.497409 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:10:46.501503 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:10:46.501984 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:10:46.515078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Flow 'volume_create_manager' (7afec056-1f1c-442b-876c-89305a7e01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:10:46.518346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e52e44-a3bb-475b-af6b-867aff129b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.526738 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:10:46.540604 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e52e44-a3bb-475b-af6b-867aff129b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-982702587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d976cf21-2639-422c-9b3a-768bad8b3bb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b55dff1681ba4140a33bf720af894950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:10:46Z,use_quota=True,user_id='f2a5b713c5064baab1441adf11be43b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.543158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b53b46-0bdf-4294-81f3-13d6c1d62a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.545831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b53b46-0bdf-4294-81f3-13d6c1d62a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.548227 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ce737-b86a-4e63-b44f-34b7cbde4201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.550424 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ce737-b86a-4e63-b44f-34b7cbde4201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976cf21-2639-422c-9b3a-768bad8b3bb1', 'volume_name': 'volume-d976cf21-2639-422c-9b3a-768bad8b3bb1', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.552738 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e93334c-90b0-4d04-ab17-f2d5ad44a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.554876 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e93334c-90b0-4d04-ab17-f2d5ad44a74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.557048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8ab42-a290-4965-b2c1-77890dc4270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.557828 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Volume d976cf21-2639-422c-9b3a-768bad8b3bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976cf21-2639-422c-9b3a-768bad8b3bb1', 'volume_size': 1} Nov 27 21:10:46.558198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] creating volume 'volume-d976cf21-2639-422c-9b3a-768bad8b3bb1' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:10:46.559192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:46.607774 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:10:46.608163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:10:46.610181 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8ab42-a290-4965-b2c1-77890dc4270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976cf21-2639-422c-9b3a-768bad8b3bb1', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.612403 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833d693-9014-4762-858d-542e68d31ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:10:46.622009 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Volume volume-d976cf21-2639-422c-9b3a-768bad8b3bb1 (d976cf21-2639-422c-9b3a-768bad8b3bb1): created successfully Nov 27 21:10:46.624677 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833d693-9014-4762-858d-542e68d31ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:10:46.627648 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Flow 'volume_create_manager' (7afec056-1f1c-442b-876c-89305a7e01a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:10:46.634775 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 req-bb9f7ff0-8f6f-49ca-ab29-6b5ba65a5f8a tempest-VolumesGetTestJSON-2006914169 None] Created volume successfully. Nov 27 21:10:47.726239 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Lock "b'cinder-d976cf21-2639-422c-9b3a-768bad8b3bb1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:10:47.762586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:47.812345 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:10:47.812775 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Volume volume-d976cf21-2639-422c-9b3a-768bad8b3bb1 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:10:47.820789 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] deleting rbd volume volume-d976cf21-2639-422c-9b3a-768bad8b3bb1 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:10:48.026140 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Created reservations ['6193004d-4cd5-4030-9880-ac244c29e2e3', 'ddbeafee-3c07-4cb0-9fda-7b3a0ea0202c', 'e7574a98-95af-4f36-83be-61d8d3c5957f', '9e2690a8-57ef-40ba-aaa9-da2bb7551042'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:10:48.068303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:48.089827 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:48.112330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:10:48.116554 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Deleted volume successfully. Nov 27 21:10:48.128676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-a9a74bb6-a4a3-42e6-8f41-543694335e6e req-681fb98f-176b-4fe1-ab41-a97618843392 tempest-VolumesGetTestJSON-2006914169 None] Lock "b'cinder-d976cf21-2639-422c-9b3a-768bad8b3bb1-delete_volume'" released by "delete_volume" :: held 0.403s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:10:57.915369 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:10:57.916586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:57.940659 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:10:57.966684 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:11:48.894790 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:11:48.898351 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:11:48.898876 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:11:48.914159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Flow 'volume_create_manager' (0f7fa9e2-2608-4760-9a33-3fcf1ef6b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:11:48.918478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e5ce29-5141-4141-9a5d-652d48799a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:48.925232 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:11:48.940331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e5ce29-5141-4141-9a5d-652d48799a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1643098714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5a366b83-a0ec-42b7-98c0-e632fe54a2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b756ba4e580446980b973ad0b42b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:11:49Z,use_quota=True,user_id='67ee436ffe774a1eb71cdb910112c7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:48.945623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0179d77-343d-4bf0-95b3-f58fa5d7b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:48.948534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0179d77-343d-4bf0-95b3-f58fa5d7b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:48.953535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6ee2e6-5c65-49b9-ae3f-e2e704b2bf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:48.957003 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6ee2e6-5c65-49b9-ae3f-e2e704b2bf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a366b83-a0ec-42b7-98c0-e632fe54a2ac', 'volume_name': 'volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:48.961325 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac95cfcb-b37a-4100-a06f-66e56614e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:48.964971 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac95cfcb-b37a-4100-a06f-66e56614e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:48.968452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a7ab9c-1545-4cdc-a6d4-cb52a4caea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:48.970019 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume 5a366b83-a0ec-42b7-98c0-e632fe54a2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac', 'volume_size': 1} Nov 27 21:11:48.970633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] creating volume 'volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:11:48.971867 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:11:49.076623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:11:49.077023 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:11:49.079204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a7ab9c-1545-4cdc-a6d4-cb52a4caea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:49.081419 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a123876-910a-474c-959d-7977db3aa10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:11:49.097543 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac (5a366b83-a0ec-42b7-98c0-e632fe54a2ac): created successfully Nov 27 21:11:49.100773 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a123876-910a-474c-959d-7977db3aa10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:11:49.106243 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Flow 'volume_create_manager' (0f7fa9e2-2608-4760-9a33-3fcf1ef6b97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:11:49.141440 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-08145315-0089-4279-9ed4-54b8db872e00 tempest-AttachVolumeShelveTestJSON-1238752384 None] Created volume successfully. Nov 27 21:11:57.912233 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:11:57.914066 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:11:57.997160 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:11:58.068734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:12:31.098412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 req-a5bab981-715d-4ff2-bcaa-6dd0fcc4b4a4 tempest-AttachVolumeShelveTestJSON-1238752384 None] No connector for attachment 7cb47d51-6236-423f-a5d7-4afc7534129f; skipping storage backend terminate_connection call. {{(pid=129088) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 27 21:12:31.099163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 req-a5bab981-715d-4ff2-bcaa-6dd0fcc4b4a4 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deleting attachment 7cb47d51-6236-423f-a5d7-4afc7534129f. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:12:57.914747 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:12:57.915489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:12:57.948749 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:12:57.981625 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:08.522191 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:13:08.525408 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:13:08.525855 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:13:08.537869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Flow 'volume_create_manager' (bc199086-ed4b-4403-98c5-11d573658979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:08.541028 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8d8305-8d4c-46c8-adbe-1dbaeb26ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.547173 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:13:08.559196 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8d8305-8d4c-46c8-adbe-1dbaeb26ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2057001096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba0d22a0-b3b8-4826-b17d-714e0539aa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3145e89af44609a08c102ae0ff2ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:13:08Z,use_quota=True,user_id='de8fba517e0246e2a2e3dd9586aa5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.561821 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c632ada9-b460-4e19-aa73-5a1a4efd09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.564024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c632ada9-b460-4e19-aa73-5a1a4efd09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.566422 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d626211-6a94-47e0-9f82-4b7ba3f1f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.568663 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d626211-6a94-47e0-9f82-4b7ba3f1f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0d22a0-b3b8-4826-b17d-714e0539aa26', 'volume_name': 'volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.571637 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939a072a-6219-4adb-8233-c8d52bfe34e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.573749 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939a072a-6219-4adb-8233-c8d52bfe34e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.575977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629a885f-bb60-4bb9-827b-153bf853c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.576758 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Volume ba0d22a0-b3b8-4826-b17d-714e0539aa26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26', 'volume_size': 1} Nov 27 21:13:08.577153 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] creating volume 'volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:13:08.578113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:08.628236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:13:08.628534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:13:08.630552 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629a885f-bb60-4bb9-827b-153bf853c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.633349 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d6ce5-0fb3-46db-89f5-80746a3c3400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:08.641741 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Volume volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26 (ba0d22a0-b3b8-4826-b17d-714e0539aa26): created successfully Nov 27 21:13:08.643786 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d6ce5-0fb3-46db-89f5-80746a3c3400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:08.646686 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Flow 'volume_create_manager' (bc199086-ed4b-4403-98c5-11d573658979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:08.655730 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-387beefa-64ff-4264-8246-f2f30235b1d9 tempest-SnapshotsActionsTest-136551677 None] Created volume successfully. Nov 27 21:13:09.705623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-703eed8c-b707-48bc-a3fb-0da2fc12b2c1 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:10.415116 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-703eed8c-b707-48bc-a3fb-0da2fc12b2c1 tempest-SnapshotsActionsTest-136551677 None] Create snapshot completed successfully Nov 27 21:13:11.084746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d50dbd7a-811e-421e-9835-c14bfc8f623c tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:11.925057 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d50dbd7a-811e-421e-9835-c14bfc8f623c tempest-SnapshotsActionsTest-136551677 None] Create snapshot completed successfully Nov 27 21:13:12.216258 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-24ea1b91-a437-4309-b478-85920de3d9eb tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-28c6e7b4-a82d-4fe4-9949-e0800df23e28-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:12.217643 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-24ea1b91-a437-4309-b478-85920de3d9eb tempest-SnapshotsActionsTest-819170604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:12.939788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-24ea1b91-a437-4309-b478-85920de3d9eb tempest-SnapshotsActionsTest-819170604 None] Created reservations ['1b8c5ee0-3b71-487e-904a-cb30111294e4', '0baf7621-6438-46d4-900a-4195c4839b43', '83657570-3404-4b24-82b6-47a47acd2aa6', 'ca5b9660-dd9c-46bf-9f4a-c14a7412e524'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:12.971596 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-24ea1b91-a437-4309-b478-85920de3d9eb tempest-SnapshotsActionsTest-819170604 None] Delete snapshot completed successfully. Nov 27 21:13:12.976128 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-24ea1b91-a437-4309-b478-85920de3d9eb tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-28c6e7b4-a82d-4fe4-9949-e0800df23e28-delete_snapshot'" released by "delete_snapshot" :: held 0.760s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:13.509277 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cc459b3d-409a-49f5-bef5-3c7a5efa9fd7 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:13.976167 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cc459b3d-409a-49f5-bef5-3c7a5efa9fd7 tempest-SnapshotsActionsTest-136551677 None] Create snapshot completed successfully Nov 27 21:13:14.621328 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dd8ed1f9-ca72-4fcd-a695-927685468dd1 tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-2a5b5f4c-33a8-426a-b95b-c0bdc7058195-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:14.622725 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dd8ed1f9-ca72-4fcd-a695-927685468dd1 tempest-SnapshotsActionsTest-819170604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:14.975578 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-dd8ed1f9-ca72-4fcd-a695-927685468dd1 tempest-SnapshotsActionsTest-819170604 None] Created reservations ['ea3d77f4-e4db-4942-931c-2beb81dceefe', '8b35c990-e568-4940-93d9-96eb10d86c5c', '4ffb8625-80cd-4f9d-8a1a-2a754ef6f164', '7ad0582d-28af-46d9-bf16-0137b269fc33'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:15.010025 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dd8ed1f9-ca72-4fcd-a695-927685468dd1 tempest-SnapshotsActionsTest-819170604 None] Delete snapshot completed successfully. Nov 27 21:13:15.014889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dd8ed1f9-ca72-4fcd-a695-927685468dd1 tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-2a5b5f4c-33a8-426a-b95b-c0bdc7058195-delete_snapshot'" released by "delete_snapshot" :: held 0.394s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:15.891080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5691155f-ffcc-4353-a85f-94813e7c6816 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:16.984213 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5691155f-ffcc-4353-a85f-94813e7c6816 tempest-SnapshotsActionsTest-136551677 None] Create snapshot completed successfully Nov 27 21:13:18.065734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ff620635-c4f2-46e8-bb29-64d3b6445c2a tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-40d63b65-bd2b-4348-a36a-580df3a488e0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:18.067980 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ff620635-c4f2-46e8-bb29-64d3b6445c2a tempest-SnapshotsActionsTest-819170604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:19.010422 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ff620635-c4f2-46e8-bb29-64d3b6445c2a tempest-SnapshotsActionsTest-819170604 None] Created reservations ['fc208596-3a20-40ee-8802-9e185b907fcd', '2a51eca6-1b34-4574-8292-9ca26ccfae02', '493bbaaf-8537-4ffc-9bb8-313e9907eb05', 'c203622c-4f7f-47c6-a6de-f1c6bfa48610'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:19.045350 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ff620635-c4f2-46e8-bb29-64d3b6445c2a tempest-SnapshotsActionsTest-819170604 None] Delete snapshot completed successfully. Nov 27 21:13:19.049976 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ff620635-c4f2-46e8-bb29-64d3b6445c2a tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-40d63b65-bd2b-4348-a36a-580df3a488e0-delete_snapshot'" released by "delete_snapshot" :: held 0.984s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:19.341276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-592e7d50-df53-4e25-b4db-efebb63b48f0 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:19.951690 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-592e7d50-df53-4e25-b4db-efebb63b48f0 tempest-SnapshotsActionsTest-136551677 None] Create snapshot completed successfully Nov 27 21:13:20.494987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-82bf9ed6-eae7-4fbb-aac7-938d71698288 tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-f8ff3cec-6cb3-4684-a240-e48acc53863f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:20.496455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82bf9ed6-eae7-4fbb-aac7-938d71698288 tempest-SnapshotsActionsTest-819170604 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:21.035117 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-82bf9ed6-eae7-4fbb-aac7-938d71698288 tempest-SnapshotsActionsTest-819170604 None] Created reservations ['fb7148f5-b80e-4fa8-b1f0-46eeda5d2f73', 'db62b7cc-a2df-4d43-8bc0-3ebe64023b54', 'd25887dd-c6d7-44ca-b5b5-2a2c8acb1170', 'f903a6fb-1d3a-4d59-b2e9-a882aa1ad735'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:21.077452 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-82bf9ed6-eae7-4fbb-aac7-938d71698288 tempest-SnapshotsActionsTest-819170604 None] Delete snapshot completed successfully. Nov 27 21:13:21.084700 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-82bf9ed6-eae7-4fbb-aac7-938d71698288 tempest-SnapshotsActionsTest-819170604 None] Lock "b'cinder-f8ff3cec-6cb3-4684-a240-e48acc53863f-delete_snapshot'" released by "delete_snapshot" :: held 0.590s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:21.960238 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ced32533-b4d0-4707-afb0-6a783738ce04 tempest-SnapshotsActionsTest-136551677 None] Lock "b'cinder-6dcdb176-111f-4394-9a55-c2081c1c001b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:21.963396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ced32533-b4d0-4707-afb0-6a783738ce04 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:23.061468 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ced32533-b4d0-4707-afb0-6a783738ce04 tempest-SnapshotsActionsTest-136551677 None] Created reservations ['6474afff-3203-4ce0-b407-899da24229e2', '95c0c3ab-7b93-4215-b111-e7ef3598e83a', 'e7189b78-6bc4-42b5-acc8-b01a919a0df5', '5cbcefcc-a32f-4db7-a14e-e033fe78bb32'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:23.095631 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ced32533-b4d0-4707-afb0-6a783738ce04 tempest-SnapshotsActionsTest-136551677 None] Delete snapshot completed successfully. Nov 27 21:13:23.107773 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ced32533-b4d0-4707-afb0-6a783738ce04 tempest-SnapshotsActionsTest-136551677 None] Lock "b'cinder-6dcdb176-111f-4394-9a55-c2081c1c001b-delete_snapshot'" released by "delete_snapshot" :: held 1.148s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:24.089895 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Lock "b'cinder-ba0d22a0-b3b8-4826-b17d-714e0539aa26-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:24.123410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:24.170390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:13:24.170771 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Volume volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:13:24.176040 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] deleting rbd volume volume-ba0d22a0-b3b8-4826-b17d-714e0539aa26 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:13:24.467015 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Created reservations ['a553e5d6-93c6-4d49-b098-3aeeb1bb8c0e', 'b5f904e7-08de-42fc-85ab-c3dd952e7174', '8b62dbc5-c126-4784-966c-27417a7afbf5', '841a4c49-27ec-45d3-b9c3-c8ed5254dce2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:24.513419 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:24.554156 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:24.593087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:24.598101 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Deleted volume successfully. Nov 27 21:13:24.613290 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4eef1778-dcf3-4f0c-bb29-26865bb78e60 tempest-SnapshotsActionsTest-136551677 None] Lock "b'cinder-ba0d22a0-b3b8-4826-b17d-714e0539aa26-delete_volume'" released by "delete_volume" :: held 0.523s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:33.489312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Lock "b'cinder-5a366b83-a0ec-42b7-98c0-e632fe54a2ac-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:33.526274 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:33.586949 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:13:33.587420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:13:33.595584 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] deleting rbd volume volume-5a366b83-a0ec-42b7-98c0-e632fe54a2ac {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:13:33.863423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Created reservations ['7a5d4a80-6b1b-4c40-902e-fc64cc0a3152', '447859d6-5591-4930-aa10-526bd50c8b90', 'f4812dc3-37e3-4887-b0e6-6a4c2e0cfd05', '01965d63-13cf-43d7-9b19-404a839812cf'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:33.913326 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:33.950746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:34.009822 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:34.014858 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deleted volume successfully. Nov 27 21:13:34.029874 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-82059a41-4b54-474f-9740-4b1fbf1260f8 tempest-AttachVolumeShelveTestJSON-1238752384 None] Lock "b'cinder-5a366b83-a0ec-42b7-98c0-e632fe54a2ac-delete_volume'" released by "delete_volume" :: held 0.541s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:34.703584 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Lock "b'cinder-4558af09-ac74-43cf-9df1-40c54ef24649-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:34.755094 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:34.835388 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:13:34.836144 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Volume volume-4558af09-ac74-43cf-9df1-40c54ef24649 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:13:34.844877 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] deleting rbd volume volume-4558af09-ac74-43cf-9df1-40c54ef24649 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:13:35.141889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Created reservations ['84de7fba-9819-4546-9e63-4528322a82de', '3d28152b-4a71-4a42-a921-398cd13ce22e', '3f9ecb05-a5ab-4dc0-b16c-235cecd12a91', '215786b1-3bc8-4d19-9c1b-7fd42a1fa2f3'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:35.200618 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:35.247558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:35.305093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:35.314518 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Deleted volume successfully. Nov 27 21:13:35.335665 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-92db8a57-e74f-4568-bbda-3d17993c6de9 tempest-AttachVolumeShelveTestJSON-1238752384 None] Lock "b'cinder-4558af09-ac74-43cf-9df1-40c54ef24649-delete_volume'" released by "delete_volume" :: held 0.631s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:36.253733 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:13:36.257135 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:13:36.257582 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:13:36.270004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Flow 'volume_create_manager' (c44d6126-4288-4ca9-b9fb-b476872e80b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:36.273759 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a66831-fd9b-4ff7-9ff1-2a1eda8ed278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.280996 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:13:36.300266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a66831-fd9b-4ff7-9ff1-2a1eda8ed278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-966461559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=845fdc64-16ca-49b6-93a9-ec4f3415f207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27044013bb53496982d1e275f135440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:13:36Z,use_quota=True,user_id='e0f8be8999054dedba4bea8843820172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4377533-1d38-4231-b374-e3d7f03ecd55),volume_type_id=e4377533-1d38-4231-b374-e3d7f03ecd55)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.303147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11decea3-4031-4335-a015-274428e0db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.305591 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11decea3-4031-4335-a015-274428e0db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.308348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618ec85d-fa8f-40b4-9eca-e76b800e2f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.310897 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618ec85d-fa8f-40b4-9eca-e76b800e2f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845fdc64-16ca-49b6-93a9-ec4f3415f207', 'volume_name': 'volume-845fdc64-16ca-49b6-93a9-ec4f3415f207', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.313273 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e05c43-b729-48c1-9c81-3350af6735b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.315471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e05c43-b729-48c1-9c81-3350af6735b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.318071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c24ba-e721-4804-8d7e-ed81ac216aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.320646 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Volume 845fdc64-16ca-49b6-93a9-ec4f3415f207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845fdc64-16ca-49b6-93a9-ec4f3415f207', 'volume_size': 1} Nov 27 21:13:36.321611 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] creating volume 'volume-845fdc64-16ca-49b6-93a9-ec4f3415f207' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:13:36.323692 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:36.433074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] extra_specs: {} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:13:36.433840 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] extra_specs: {} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:13:36.437729 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c24ba-e721-4804-8d7e-ed81ac216aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845fdc64-16ca-49b6-93a9-ec4f3415f207', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.450024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487adb6e-3cd2-4590-a4a2-7305f3b2facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:36.464633 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Volume volume-845fdc64-16ca-49b6-93a9-ec4f3415f207 (845fdc64-16ca-49b6-93a9-ec4f3415f207): created successfully Nov 27 21:13:36.466828 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487adb6e-3cd2-4590-a4a2-7305f3b2facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:36.470256 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Flow 'volume_create_manager' (c44d6126-4288-4ca9-b9fb-b476872e80b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:36.491747 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-144c2c50-9ca1-4fc4-b3ec-4fd9d24886d6 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Created volume successfully. Nov 27 21:13:37.829450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-013b9cfe-eb10-4e38-9431-e9d679005582 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:37.897272 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-013b9cfe-eb10-4e38-9431-e9d679005582 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:37.981409 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-013b9cfe-eb10-4e38-9431-e9d679005582 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:37.986824 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-013b9cfe-eb10-4e38-9431-e9d679005582 tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Retype volume completed successfully. Nov 27 21:13:39.127112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Lock "b'cinder-845fdc64-16ca-49b6-93a9-ec4f3415f207-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:13:39.216311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:39.322689 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:13:39.323112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Volume volume-845fdc64-16ca-49b6-93a9-ec4f3415f207 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:13:39.334681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] deleting rbd volume volume-845fdc64-16ca-49b6-93a9-ec4f3415f207 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:13:39.682894 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:13:39.685733 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:13:39.706813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Created reservations ['2984b675-34e3-49ca-aecf-b1f63598fae8', '3d6b6c53-7155-4986-ab1d-2dbd3f0a3a33', 'dfeb23a1-39c4-4df3-8901-d492193d7248', '1bc50ae0-eec9-49e2-939b-6ade6202a0a2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:13:39.766241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:39.829951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:39.902918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:39.913420 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Deleted volume successfully. Nov 27 21:13:39.937752 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f05ecac6-ac35-450f-a377-4cf68ad2e7ab tempest-VolumeRetypeWithoutMigrationTest-1738467919 None] Lock "b'cinder-845fdc64-16ca-49b6-93a9-ec4f3415f207-delete_volume'" released by "delete_volume" :: held 0.811s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:13:46.578447 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:13:46.583492 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:13:46.584312 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:13:46.603875 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (dca5c51e-f7b5-401e-9b0d-286399a3bed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:46.607799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b706c28-5245-461a-8610-f4772a3146d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.615649 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:13:46.630021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b706c28-5245-461a-8610-f4772a3146d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1490996801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc95af6a-3bbf-4795-81b0-cda182d7053e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346617e7aa44828af349d91bd2487eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:13:47Z,use_quota=True,user_id='470174c865c547e48a55751015c69931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.639632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78cd23d-5742-4b39-aafa-a75546b527cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.642158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78cd23d-5742-4b39-aafa-a75546b527cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.645025 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d640c0-7d85-4917-9ee9-709bfde6363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.647695 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d640c0-7d85-4917-9ee9-709bfde6363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc95af6a-3bbf-4795-81b0-cda182d7053e', 'volume_name': 'volume-bc95af6a-3bbf-4795-81b0-cda182d7053e', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.651315 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e6923-5202-422d-8840-58456ad52ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.654248 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e6923-5202-422d-8840-58456ad52ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.657247 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e4f8f0-02c5-4446-a4b0-eace818e1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.658543 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Volume bc95af6a-3bbf-4795-81b0-cda182d7053e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc95af6a-3bbf-4795-81b0-cda182d7053e', 'volume_size': 1} Nov 27 21:13:46.659451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] creating volume 'volume-bc95af6a-3bbf-4795-81b0-cda182d7053e' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:13:46.660727 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:46.795045 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:13:46.795857 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:13:46.798302 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e4f8f0-02c5-4446-a4b0-eace818e1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc95af6a-3bbf-4795-81b0-cda182d7053e', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.801201 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623a98c-9575-4250-b4a3-247f81188a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:13:46.819998 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-bc95af6a-3bbf-4795-81b0-cda182d7053e (bc95af6a-3bbf-4795-81b0-cda182d7053e): created successfully Nov 27 21:13:46.823522 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c623a98c-9575-4250-b4a3-247f81188a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:13:46.829330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (dca5c51e-f7b5-401e-9b0d-286399a3bed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:13:46.845474 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ab4baf3c-f08d-4e09-975f-8e60c36da253 tempest-VolumesBackupsAdminTest-1903881971 None] Created volume successfully. Nov 27 21:13:53.194624 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:13:54.310547 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.116s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:13:54.312317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bc95af6a-3bbf-4795-81b0-cda182d7053e', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'bc95af6a-3bbf-4795-81b0-cda182d7053e', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:13:54.331870 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] Initialize volume connection completed successfully. Nov 27 21:13:57.917685 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:13:57.919455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:57.950616 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:13:58.010527 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:13:58.665398 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] Terminate volume connection completed successfully. Nov 27 21:13:58.684459 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-05f6bba3-2ff6-460f-aabf-dc7ae88e92cc tempest-VolumesBackupsAdminTest-1903881971 None] Remove volume export completed successfully. Nov 27 21:14:01.360400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:14:01.364057 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:14:01.364558 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:14:01.380271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (2a73e01e-17c9-4c65-b2de-3e5c8e2d8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:14:01.384698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3087b92-6661-45ec-b74e-7470ec40b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.391063 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:14:01.404241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3087b92-6661-45ec-b74e-7470ec40b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:14:01Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3997df94-7bf1-415e-ae47-e84b32d51bb3',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d9674cb-0c68-4cf7-85a9-1a4f8311055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346617e7aa44828af349d91bd2487eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:14:01Z,use_quota=True,user_id='470174c865c547e48a55751015c69931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.406838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927ec618-348a-418c-aae7-f7caffb1fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.409033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927ec618-348a-418c-aae7-f7caffb1fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.411482 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cf9384-31fc-403f-bea0-aac9fe2730b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.413766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cf9384-31fc-403f-bea0-aac9fe2730b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'volume_name': 'volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.416125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf313b7-aaf7-42c7-a6f3-77881fecdf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.418271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf313b7-aaf7-42c7-a6f3-77881fecdf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.420531 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6b5e9e-f8e0-4c49-a359-9d55cd17dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.421324 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Volume 0d9674cb-0c68-4cf7-85a9-1a4f8311055a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'volume_size': 1} Nov 27 21:14:01.421730 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] creating volume 'volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:14:01.422719 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:01.479991 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:14:01.480373 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:14:01.482422 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6b5e9e-f8e0-4c49-a359-9d55cd17dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.484658 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14268705-7d99-482c-a0fc-8972c6475849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:01.493092 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a (0d9674cb-0c68-4cf7-85a9-1a4f8311055a): created successfully Nov 27 21:14:01.494894 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14268705-7d99-482c-a0fc-8972c6475849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:01.497878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (2a73e01e-17c9-4c65-b2de-3e5c8e2d8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:14:01.504854 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Created volume successfully. Nov 27 21:14:02.431319 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:14:03.059983 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.628s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:14:03.060781 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '0d9674cb-0c68-4cf7-85a9-1a4f8311055a', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:14:03.084829 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Initialize volume connection completed successfully. Nov 27 21:14:04.522660 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Terminate volume connection completed successfully. Nov 27 21:14:04.538530 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0ce1a5f6-918b-426e-bad3-bd4a014c6bee tempest-VolumesBackupsAdminTest-1903881971 None] Remove volume export completed successfully. Nov 27 21:14:05.611389 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-0d9674cb-0c68-4cf7-85a9-1a4f8311055a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:14:05.648728 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:06.373472 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:14:06.391589 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] deleting rbd volume volume-0d9674cb-0c68-4cf7-85a9-1a4f8311055a {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:14:06.662513 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Created reservations ['069ef56c-ca4d-49d5-a734-69f399151192', 'e18dd854-1c2f-44eb-beac-306270c94410', 'f83d98d8-c202-429a-8dd5-123cf67451a6', '764c3067-761b-4132-b010-94311810927a'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:14:06.712443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:06.740120 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:06.783868 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:14:06.789588 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Deleted volume successfully. Nov 27 21:14:06.801643 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-d57ba659-b067-443d-bc6e-683f3c846eb3 tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-0d9674cb-0c68-4cf7-85a9-1a4f8311055a-delete_volume'" released by "delete_volume" :: held 1.190s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:14:09.285659 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:14:09.289501 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:14:09.290723 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:14:09.305013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (6c2f0d34-b596-41e0-8276-cae58b036eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:14:09.310686 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c573a5aa-7c64-4084-b8a6-eb4dd323250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.319158 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:14:09.334226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c573a5aa-7c64-4084-b8a6-eb4dd323250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1108942153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346617e7aa44828af349d91bd2487eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:14:09Z,use_quota=True,user_id='470174c865c547e48a55751015c69931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.337666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a113770-084d-46fd-a6dd-2d2b5b22a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.340178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a113770-084d-46fd-a6dd-2d2b5b22a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.342921 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37131d0-f0cb-4755-a05c-6dd2e09aa24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.345390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37131d0-f0cb-4755-a05c-6dd2e09aa24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'volume_name': 'volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.348947 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bff36d-7f8d-498b-9b48-358ab5fb16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.351161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bff36d-7f8d-498b-9b48-358ab5fb16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.354299 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52efddc-a82a-448b-a686-3986c5c7545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.355199 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Volume e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'volume_size': 1} Nov 27 21:14:09.355850 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] creating volume 'volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:14:09.357124 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:09.461266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:14:09.461761 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:14:09.464137 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52efddc-a82a-448b-a686-3986c5c7545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.466722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8367597-76ff-46da-a07b-2ee1954cbaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:14:09.477992 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8 (e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8): created successfully Nov 27 21:14:09.480818 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8367597-76ff-46da-a07b-2ee1954cbaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:14:09.484378 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Flow 'volume_create_manager' (6c2f0d34-b596-41e0-8276-cae58b036eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:14:09.495159 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c8149aad-ecfa-4c62-b8b8-34336089038f tempest-VolumesBackupsAdminTest-1903881971 None] Created volume successfully. Nov 27 21:14:10.456215 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:14:11.083194 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:14:11.083931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:14:11.099129 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] Initialize volume connection completed successfully. Nov 27 21:14:13.108157 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] Terminate volume connection completed successfully. Nov 27 21:14:13.123670 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-00dfceca-0bb1-49db-9fd1-a5682ce2d007 tempest-VolumesBackupsAdminTest-1903881971 None] Remove volume export completed successfully. Nov 27 21:14:14.658392 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:14:14.689051 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:14.952503 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:14:14.966438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] deleting rbd volume volume-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:14:15.168127 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Created reservations ['b03fd2f1-4370-4e56-8fb1-51ee620091b2', 'fbf8f26b-6cb1-4b0c-81af-5dd47cc2bd91', 'a1150d10-4c4f-4053-bf35-bff622dc3d7b', '30cad0de-d399-4ce0-bec3-6a3335f8045d'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:14:15.213341 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:15.236330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:15.260132 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:14:15.264152 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Deleted volume successfully. Nov 27 21:14:15.275894 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e4f44f3c-36ae-4798-8aa2-1339ff235adb tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-e5a5170d-1ec9-45eb-9d9e-1ddf391b46d8-delete_volume'" released by "delete_volume" :: held 0.618s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:14:15.784265 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-bc95af6a-3bbf-4795-81b0-cda182d7053e-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:14:15.825600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:16.030076 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Volume volume-bc95af6a-3bbf-4795-81b0-cda182d7053e is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:14:16.051721 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] deleting rbd volume volume-bc95af6a-3bbf-4795-81b0-cda182d7053e {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:14:16.289061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Created reservations ['1eb3b462-4632-4241-b834-5a94bd860373', '687dbe24-9b72-4f29-ba8c-375c83c02eef', 'db6629bb-5586-4dfd-af2d-b58c36573f7d', 'eadaee1d-bd25-475f-8ac4-f07080bf9d18'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:14:16.327423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:16.348865 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:16.371807 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:14:16.375809 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Deleted volume successfully. Nov 27 21:14:16.387998 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-fd9bddbe-c26a-4d8c-a6cc-f920186b578c tempest-VolumesBackupsAdminTest-1903881971 None] Lock "b'cinder-bc95af6a-3bbf-4795-81b0-cda182d7053e-delete_volume'" released by "delete_volume" :: held 0.604s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:14:57.917655 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:14:57.918317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:57.940539 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:14:57.962128 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:15:50.095591 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:15:50.099112 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:15:50.099619 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:15:50.112450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (a9607835-dde5-4693-995e-282bd0846fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:15:50.115972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b21b2-9836-4444-a012-659d4b80e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.123045 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:15:50.135063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332b21b2-9836-4444-a012-659d4b80e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081325140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62a70256-eb0c-4887-87f1-84cf766abe3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219be90852c0481aaad9862d1a485102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:15:50Z,use_quota=True,user_id='b771da0354414b239da0cad505f8ffe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.137678 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb34c1e-5400-44c3-b99e-5e38819b155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.139816 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb34c1e-5400-44c3-b99e-5e38819b155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.142190 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091609e-cffc-46a7-8cde-98dfc12e15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.144442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091609e-cffc-46a7-8cde-98dfc12e15c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a70256-eb0c-4887-87f1-84cf766abe3c', 'volume_name': 'volume-62a70256-eb0c-4887-87f1-84cf766abe3c', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.146719 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649d0263-a1b8-4f66-bde9-02e22582c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.148835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649d0263-a1b8-4f66-bde9-02e22582c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.151013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d82cb1-9975-4581-8487-d2403d3e055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.151820 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Volume 62a70256-eb0c-4887-87f1-84cf766abe3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a70256-eb0c-4887-87f1-84cf766abe3c', 'volume_size': 1} Nov 27 21:15:50.152218 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] creating volume 'volume-62a70256-eb0c-4887-87f1-84cf766abe3c' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:15:50.153203 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:15:50.202741 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:15:50.203147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:15:50.205213 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d82cb1-9975-4581-8487-d2403d3e055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a70256-eb0c-4887-87f1-84cf766abe3c', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.207449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1761866-409b-4d71-bed7-0449e01d295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:15:50.216862 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-62a70256-eb0c-4887-87f1-84cf766abe3c (62a70256-eb0c-4887-87f1-84cf766abe3c): created successfully Nov 27 21:15:50.218796 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1761866-409b-4d71-bed7-0449e01d295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:15:50.221791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (a9607835-dde5-4693-995e-282bd0846fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:15:50.229079 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-78bffa73-ea58-4dc0-83eb-d56436d692bb tempest-AttachVolumeTestJSON-1651489591 None] Created volume successfully. Nov 27 21:15:51.501254 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 req-d03d09b9-9bde-410a-8646-2bfb06277482 tempest-AttachVolumeTestJSON-1651489591 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:15:52.134028 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 req-d03d09b9-9bde-410a-8646-2bfb06277482 tempest-AttachVolumeTestJSON-1651489591 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:15:52.134876 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 req-d03d09b9-9bde-410a-8646-2bfb06277482 tempest-AttachVolumeTestJSON-1651489591 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-62a70256-eb0c-4887-87f1-84cf766abe3c', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '62a70256-eb0c-4887-87f1-84cf766abe3c', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:15:52.160439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 req-d03d09b9-9bde-410a-8646-2bfb06277482 tempest-AttachVolumeTestJSON-1651489591 None] Connection info returned from driver {'name': 'volumes/volume-62a70256-eb0c-4887-87f1-84cf766abe3c', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '62a70256-eb0c-4887-87f1-84cf766abe3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0521721a-f574-4b8e-a566-557bf72704bb'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:15:52.217656 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 req-d03d09b9-9bde-410a-8646-2bfb06277482 tempest-AttachVolumeTestJSON-1651489591 None] attachment_update completed successfully. Nov 27 21:15:57.917435 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:15:57.918465 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:15:57.946864 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:15:57.973307 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:16:44.347875 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e req-f054cd88-d7a4-4d31-b81a-fd954fccf7e1 tempest-AttachVolumeTestJSON-1651489591 None] Terminate volume connection completed successfully. Nov 27 21:16:44.348582 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e req-f054cd88-d7a4-4d31-b81a-fd954fccf7e1 tempest-AttachVolumeTestJSON-1651489591 None] Deleting attachment 0521721a-f574-4b8e-a566-557bf72704bb. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:16:57.919193 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:16:57.919963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:16:57.969601 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:16:58.037925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:17:10.474283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:17:10.478126 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:17:10.478708 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:17:10.493730 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Flow 'volume_create_manager' (098d76c5-d952-459e-84cc-59ccbc397319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:17:10.497255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959bdb7c-2fea-4498-a2df-6fbd172273a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.503352 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:17:10.515824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959bdb7c-2fea-4498-a2df-6fbd172273a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1266800954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3efbf41a-878d-4a5c-a608-be90f8428491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b505a883a825408698c3d922940ee1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:17:10Z,use_quota=True,user_id='7c8324b8572a407eb60a7930b819db67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.518461 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789ae5a4-83e1-4009-9e17-af3f27337199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.520627 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789ae5a4-83e1-4009-9e17-af3f27337199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.523083 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04c9106-70f3-473d-ac53-9471b06c1e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.525296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04c9106-70f3-473d-ac53-9471b06c1e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efbf41a-878d-4a5c-a608-be90f8428491', 'volume_name': 'volume-3efbf41a-878d-4a5c-a608-be90f8428491', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.528541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abed5fea-f3a5-45bc-bd02-f21e6d5cce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.530657 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abed5fea-f3a5-45bc-bd02-f21e6d5cce69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.532867 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ea4bd7-03a5-45d1-8281-baacaa38d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.534113 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Volume 3efbf41a-878d-4a5c-a608-be90f8428491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efbf41a-878d-4a5c-a608-be90f8428491', 'volume_size': 1} Nov 27 21:17:10.534113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] creating volume 'volume-3efbf41a-878d-4a5c-a608-be90f8428491' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:17:10.534994 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:10.594652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:17:10.595028 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:17:10.597083 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ea4bd7-03a5-45d1-8281-baacaa38d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efbf41a-878d-4a5c-a608-be90f8428491', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.599286 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33b0287-5e69-4697-8d81-80d7a0e41f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:17:10.609764 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Volume volume-3efbf41a-878d-4a5c-a608-be90f8428491 (3efbf41a-878d-4a5c-a608-be90f8428491): created successfully Nov 27 21:17:10.611915 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33b0287-5e69-4697-8d81-80d7a0e41f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:17:10.615182 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Flow 'volume_create_manager' (098d76c5-d952-459e-84cc-59ccbc397319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:17:10.624916 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 req-c3512c7a-7db9-4573-9b85-494801e8bb86 tempest-VolumesSnapshotsTestJSON-139434804 None] Created volume successfully. Nov 27 21:17:11.746377 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-9dd1b6d4-e2e4-49dc-bc44-fd81d1e91419 req-01462f06-5cf8-47fc-b9c5-d125128f40e7 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:12.181333 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-9dd1b6d4-e2e4-49dc-bc44-fd81d1e91419 req-01462f06-5cf8-47fc-b9c5-d125128f40e7 tempest-VolumesSnapshotsTestJSON-139434804 None] Create snapshot completed successfully Nov 27 21:17:12.942071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-cc53ad40-ef34-4519-a814-ed12ec9c58fd req-043f9433-83af-4e52-9738-09fd9f4260e8 tempest-VolumesSnapshotsTestJSON-139434804 None] Lock "b'cinder-d4f831cb-43a4-413a-85f7-56d466a9b1cb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:17:12.943595 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-cc53ad40-ef34-4519-a814-ed12ec9c58fd req-043f9433-83af-4e52-9738-09fd9f4260e8 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:13.212111 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-cc53ad40-ef34-4519-a814-ed12ec9c58fd req-043f9433-83af-4e52-9738-09fd9f4260e8 tempest-VolumesSnapshotsTestJSON-139434804 None] Created reservations ['6d09a6a4-ad90-41a4-97cc-97d044d40c02', '8d2cfa40-4024-4054-acd2-bb9c0d0de9b0', '44bb15b7-b401-4552-bfdb-0f1857ea35cd', '528f525d-9242-4228-8012-0cc9f81c507b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:17:13.245360 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-cc53ad40-ef34-4519-a814-ed12ec9c58fd req-043f9433-83af-4e52-9738-09fd9f4260e8 tempest-VolumesSnapshotsTestJSON-139434804 None] Delete snapshot completed successfully. Nov 27 21:17:13.250033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-cc53ad40-ef34-4519-a814-ed12ec9c58fd req-043f9433-83af-4e52-9738-09fd9f4260e8 tempest-VolumesSnapshotsTestJSON-139434804 None] Lock "b'cinder-d4f831cb-43a4-413a-85f7-56d466a9b1cb-delete_snapshot'" released by "delete_snapshot" :: held 0.308s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:17:14.092592 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Lock "b'cinder-3efbf41a-878d-4a5c-a608-be90f8428491-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:17:14.123444 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:14.173402 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:17:14.173854 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Volume volume-3efbf41a-878d-4a5c-a608-be90f8428491 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:17:14.179418 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] deleting rbd volume volume-3efbf41a-878d-4a5c-a608-be90f8428491 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:17:14.389418 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Created reservations ['f86d12d7-66a9-4bd6-939d-436236d653ed', 'b83dbe15-e375-4fac-8d36-75fa9446f254', '0933bc0d-6c00-4eb8-b335-c7ddba3d9b5a', 'f7cced68-6176-41c7-8b19-336140f36df0'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:17:14.435890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:14.468478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:14.493327 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:17:14.498110 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Deleted volume successfully. Nov 27 21:17:14.510471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-2c939a9a-8fec-462c-a333-8a9a23b01da9 req-770cd2bc-d7be-453d-be75-5dc6068f0016 tempest-VolumesSnapshotsTestJSON-139434804 None] Lock "b'cinder-3efbf41a-878d-4a5c-a608-be90f8428491-delete_volume'" released by "delete_volume" :: held 0.418s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:17:57.917151 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:17:57.919085 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:57.958192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:17:57.997423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:15.755073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:15.758258 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:15.758701 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:15.770143 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Flow 'volume_create_manager' (2ac52cfc-c6b4-4428-abd5-0d715112bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:15.773627 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ad8c99-0391-49dc-bd8d-1cc2fc4f7ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.780155 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:15.794071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ad8c99-0391-49dc-bd8d-1cc2fc4f7ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-86283759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f834edad-60a8-43ff-98b3-78fd7f14c826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca7a3e04250448faf5f1c9959ff56e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:16Z,use_quota=True,user_id='2d55b7433cc74fd68422cc9152ab1b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.796629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79f5263-f499-46f8-b937-7ef113058402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.798747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79f5263-f499-46f8-b937-7ef113058402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.801162 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a58b03-6ac3-4b66-aeaf-0ca4a5618c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.803427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a58b03-6ac3-4b66-aeaf-0ca4a5618c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f834edad-60a8-43ff-98b3-78fd7f14c826', 'volume_name': 'volume-f834edad-60a8-43ff-98b3-78fd7f14c826', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.805739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e43f3e1-255e-48cd-bc7e-ae564a60e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.807869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e43f3e1-255e-48cd-bc7e-ae564a60e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.810057 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed822c-1b9c-4fb8-8108-def5aec7be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.810820 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume f834edad-60a8-43ff-98b3-78fd7f14c826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f834edad-60a8-43ff-98b3-78fd7f14c826', 'volume_size': 1} Nov 27 21:18:15.811212 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] creating volume 'volume-f834edad-60a8-43ff-98b3-78fd7f14c826' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:15.812173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:15.862944 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:15.863277 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:15.865561 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed822c-1b9c-4fb8-8108-def5aec7be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f834edad-60a8-43ff-98b3-78fd7f14c826', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.867845 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309801cb-a4bd-45ec-a0a4-d0585d5b9fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:15.876668 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume volume-f834edad-60a8-43ff-98b3-78fd7f14c826 (f834edad-60a8-43ff-98b3-78fd7f14c826): created successfully Nov 27 21:18:15.878764 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309801cb-a4bd-45ec-a0a4-d0585d5b9fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:15.881789 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Flow 'volume_create_manager' (2ac52cfc-c6b4-4428-abd5-0d715112bd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:15.888852 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-18be6a65-62d9-4df8-a677-5673e3c98cd7 tempest-VolumeQuotasAdminTestJSON-13189235 None] Created volume successfully. Nov 27 21:18:16.868435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Lock "b'cinder-f834edad-60a8-43ff-98b3-78fd7f14c826-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:16.897888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:16.935651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:16.936022 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume volume-f834edad-60a8-43ff-98b3-78fd7f14c826 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:16.941125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] deleting rbd volume volume-f834edad-60a8-43ff-98b3-78fd7f14c826 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:17.142431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Created reservations ['a720b66e-cce8-4219-b6a0-2a5347a055cf', 'e12c9dfb-44cb-4ad2-b9b5-3fe3e1748842', '51f8e34f-c94d-4d96-9d82-ec69fcfc3bab', 'b918ee3f-af8a-4409-9cf1-f4b13d43c546'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:17.181403 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:17.204452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:17.226087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:17.230204 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Deleted volume successfully. Nov 27 21:18:17.242204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5a279075-475f-4a74-ae9d-20bc4d2d8fcb tempest-VolumeQuotasAdminTestJSON-13189235 None] Lock "b'cinder-f834edad-60a8-43ff-98b3-78fd7f14c826-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:18.212730 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:18.216525 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:18.216963 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:18.228619 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Flow 'volume_create_manager' (f41efbce-ee94-4a4e-9d74-eb9a802e17b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:18.232093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aed6ce-bf5e-421a-af7f-889456141cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.238081 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:18.251773 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aed6ce-bf5e-421a-af7f-889456141cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-696316632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec3fb9f5-e421-49c3-b65b-f690da586401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca7a3e04250448faf5f1c9959ff56e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:18Z,use_quota=True,user_id='2d55b7433cc74fd68422cc9152ab1b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.254364 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903bbc57-6818-4e2d-ade7-0c6deb3a6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.256562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903bbc57-6818-4e2d-ade7-0c6deb3a6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.258964 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b9a64-ae2d-441e-8cfb-0ed8f268e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.261726 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b9a64-ae2d-441e-8cfb-0ed8f268e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3fb9f5-e421-49c3-b65b-f690da586401', 'volume_name': 'volume-ec3fb9f5-e421-49c3-b65b-f690da586401', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.264074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653de566-54b6-423b-a0b4-e32f720b181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.266197 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653de566-54b6-423b-a0b4-e32f720b181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.268432 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23066ff4-f726-421e-a58e-d356ad461eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.269212 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume ec3fb9f5-e421-49c3-b65b-f690da586401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3fb9f5-e421-49c3-b65b-f690da586401', 'volume_size': 1} Nov 27 21:18:18.269603 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] creating volume 'volume-ec3fb9f5-e421-49c3-b65b-f690da586401' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:18.270566 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:18.318784 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:18.319159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:18.321249 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23066ff4-f726-421e-a58e-d356ad461eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3fb9f5-e421-49c3-b65b-f690da586401', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.324039 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59531285-7af0-48ea-a227-d2591c5d251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:18.332606 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Volume volume-ec3fb9f5-e421-49c3-b65b-f690da586401 (ec3fb9f5-e421-49c3-b65b-f690da586401): created successfully Nov 27 21:18:18.334443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59531285-7af0-48ea-a227-d2591c5d251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:18.337513 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Flow 'volume_create_manager' (f41efbce-ee94-4a4e-9d74-eb9a802e17b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:18.345301 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6bc8afa1-9680-40a8-92c5-fcd87d3293a4 tempest-VolumeQuotasAdminTestJSON-13189235 None] Created volume successfully. Nov 27 21:18:19.701584 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-32461db8-2226-4f1d-ae14-ce1f827874d5 tempest-VolumeQuotasAdminTestJSON-1584583686 None] Transfer volume completed successfully. Nov 27 21:18:20.022499 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Lock "b'cinder-ec3fb9f5-e421-49c3-b65b-f690da586401-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:20.046682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:20.087539 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:20.088091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Volume volume-ec3fb9f5-e421-49c3-b65b-f690da586401 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:20.092964 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] deleting rbd volume volume-ec3fb9f5-e421-49c3-b65b-f690da586401 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:20.288079 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Created reservations ['b5fa12f0-267b-451b-b313-43e45e8412f6', '69ebc928-a4de-43fc-85fa-e6d40d7bdb0b', 'b477dc54-28ea-4d86-a5d6-b5950f196bdd', 'a524a245-9857-4a84-81e3-27d9f7e7e84d'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:20.327718 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:20.350012 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:20.372944 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:20.377168 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Deleted volume successfully. Nov 27 21:18:20.389313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e1c4830a-5c4b-4b5a-8eb5-be7ca359cd7d tempest-VolumeQuotasAdminTestJSON-495936157 None] Lock "b'cinder-ec3fb9f5-e421-49c3-b65b-f690da586401-delete_volume'" released by "delete_volume" :: held 0.367s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:24.906311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:24.911624 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:24.912292 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:24.926248 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Flow 'volume_create_manager' (e67cf08c-6170-4792-a171-bc2b92190814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:24.929758 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1e5ea4-a141-4465-8042-8800252cfdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:24.941249 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:24.955812 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1e5ea4-a141-4465-8042-8800252cfdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-234611119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b91748d-785c-4c50-98f2-84d4d88a04ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54429e07fac428fa9ba2be3ac7bb890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:25Z,use_quota=True,user_id='f4d521e07662474eae54efe6617156d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:24.958399 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725795ca-a290-47ef-9a98-55bc5d13dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:24.960932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725795ca-a290-47ef-9a98-55bc5d13dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:24.963293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a8bdcb-c57b-42ed-a2f1-a6c0d3943278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:24.966177 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a8bdcb-c57b-42ed-a2f1-a6c0d3943278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b91748d-785c-4c50-98f2-84d4d88a04ce', 'volume_name': 'volume-8b91748d-785c-4c50-98f2-84d4d88a04ce', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:24.971662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0949313b-e70d-4aa3-8709-a332713bdf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:24.974947 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0949313b-e70d-4aa3-8709-a332713bdf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:24.977200 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad114b59-6d92-4c51-b4e3-98d00a11c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:24.978185 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Volume 8b91748d-785c-4c50-98f2-84d4d88a04ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b91748d-785c-4c50-98f2-84d4d88a04ce', 'volume_size': 1} Nov 27 21:18:24.978580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] creating volume 'volume-8b91748d-785c-4c50-98f2-84d4d88a04ce' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:24.979637 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:25.036794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:25.037310 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:25.039435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad114b59-6d92-4c51-b4e3-98d00a11c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b91748d-785c-4c50-98f2-84d4d88a04ce', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:25.041647 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f5dfd9-3f5b-4120-bdc2-1993b0de5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:25.050125 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Volume volume-8b91748d-785c-4c50-98f2-84d4d88a04ce (8b91748d-785c-4c50-98f2-84d4d88a04ce): created successfully Nov 27 21:18:25.052612 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f5dfd9-3f5b-4120-bdc2-1993b0de5049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:25.056367 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Flow 'volume_create_manager' (e67cf08c-6170-4792-a171-bc2b92190814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:25.064847 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4e7fbe56-f99a-4768-8ea7-ad47872cc2db tempest-AbsoluteLimitsTests-434840356 None] Created volume successfully. Nov 27 21:18:26.014748 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Lock "b'cinder-8b91748d-785c-4c50-98f2-84d4d88a04ce-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:26.051145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:26.100244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:26.100873 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Volume volume-8b91748d-785c-4c50-98f2-84d4d88a04ce is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:26.107897 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] deleting rbd volume volume-8b91748d-785c-4c50-98f2-84d4d88a04ce {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:26.314248 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Created reservations ['3ad0fea0-d1e6-4270-b5f1-19ce01d99694', 'ee08c6b7-1bc8-410d-a0ea-33fe639d1a51', '3838b9ed-63a4-4641-b2eb-85e092ab9fb3', 'e50fa967-3cfd-4f4d-8e50-d8bd8a4d5afd'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:26.359779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:26.381318 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:26.417615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:26.421875 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Deleted volume successfully. Nov 27 21:18:26.435283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cf8d7d19-730e-4581-b33e-f9e5d38cdaff tempest-AbsoluteLimitsTests-434840356 None] Lock "b'cinder-8b91748d-785c-4c50-98f2-84d4d88a04ce-delete_volume'" released by "delete_volume" :: held 0.421s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:29.352149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:29.355718 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:29.356189 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:29.370781 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Flow 'volume_create_manager' (11581c56-f507-44b6-ade5-79c973dc8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:29.373925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fea243-d901-46a2-949d-a5c5b8eebd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.380372 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:29.393216 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fea243-d901-46a2-949d-a5c5b8eebd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-274158973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=69f7cbd5-ca16-4ad9-b49d-dd66213e9539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2017a682ca354efb855b24073b3d494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:29Z,use_quota=True,user_id='3867437fbb4e4d799a225a07de794cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.396087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ecb93-18df-4cef-bb53-211b912718db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.398215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ecb93-18df-4cef-bb53-211b912718db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.400649 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22aa3c1-c156-4283-bf63-5c9d052ec33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.402886 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22aa3c1-c156-4283-bf63-5c9d052ec33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'volume_name': 'volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.405230 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea7eae-1b61-451a-8bd3-adbaa5a4ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.407372 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea7eae-1b61-451a-8bd3-adbaa5a4ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.409712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8965a3ad-e8fd-450f-a3f4-4afb3e36e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.410651 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Volume 69f7cbd5-ca16-4ad9-b49d-dd66213e9539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'volume_size': 1} Nov 27 21:18:29.411165 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] creating volume 'volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:29.412328 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:29.468920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:29.469297 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:29.471322 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8965a3ad-e8fd-450f-a3f4-4afb3e36e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.473541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d803b25-a804-4979-a7f1-478dc98fa64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:29.482570 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Volume volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539 (69f7cbd5-ca16-4ad9-b49d-dd66213e9539): created successfully Nov 27 21:18:29.484373 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d803b25-a804-4979-a7f1-478dc98fa64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:29.487294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Flow 'volume_create_manager' (11581c56-f507-44b6-ade5-79c973dc8702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:29.494515 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-090c5217-e850-448b-af4f-6939d9caa787 tempest-VolumesBackupsV39Test-523004824 None] Created volume successfully. Nov 27 21:18:30.605399 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:18:31.240432 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.635s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:18:31.241215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '69f7cbd5-ca16-4ad9-b49d-dd66213e9539', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:18:31.256568 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] Initialize volume connection completed successfully. Nov 27 21:18:33.340496 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] Terminate volume connection completed successfully. Nov 27 21:18:33.358856 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f8b345a7-dfa0-4e89-8ffb-522a81f19ee1 tempest-VolumesBackupsV39Test-523004824 None] Remove volume export completed successfully. Nov 27 21:18:34.815786 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Lock "b'cinder-69f7cbd5-ca16-4ad9-b49d-dd66213e9539-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:34.845924 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:35.242221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Volume volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:35.256090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] deleting rbd volume volume-69f7cbd5-ca16-4ad9-b49d-dd66213e9539 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:35.452472 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Created reservations ['b0f576eb-0f4a-49b7-95d0-ae0de2aea0ab', 'a5fca4fd-eaa8-4752-bf42-42bb98c83963', '03e52c93-70e7-45d0-9438-4d866b8db8f7', '04273b79-863f-43a0-b9a3-38872c0bfcd5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:35.492383 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:35.514417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:35.536259 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:35.540463 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Deleted volume successfully. Nov 27 21:18:35.552944 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3307c5fa-bd22-482c-bb09-0b293b6c4249 tempest-VolumesBackupsV39Test-523004824 None] Lock "b'cinder-69f7cbd5-ca16-4ad9-b49d-dd66213e9539-delete_volume'" released by "delete_volume" :: held 0.737s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:37.670887 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:37.675803 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:37.676619 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:37.691528 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Flow 'volume_create_manager' (b3e20bb9-2e68-41d5-a41c-bfb8733c271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:37.695266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9561f1b-0ea1-4c3e-9db1-51867ef881fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:37.701649 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:37.713784 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9561f1b-0ea1-4c3e-9db1-51867ef881fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1463174156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=997c8bfa-d1dd-4da6-9522-0fd9aae4d92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a177f11d9942a8a518569075cf5578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:38Z,use_quota=True,user_id='756f825c3dca46609964845883f98077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:37.716393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8353eab-65ac-4e63-89b5-9b8adfc33720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:37.718543 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8353eab-65ac-4e63-89b5-9b8adfc33720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:37.720996 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c391bc-1db8-4d2f-91b3-cd120edaffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:37.799594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c391bc-1db8-4d2f-91b3-cd120edaffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '997c8bfa-d1dd-4da6-9522-0fd9aae4d92d', 'volume_name': 'volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:37.801994 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd14188-38d0-49cd-852a-eaa0bdacd7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:37.804209 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd14188-38d0-49cd-852a-eaa0bdacd7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:37.806436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cfe233-2f4e-450b-8c10-56fc2825e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:37.807987 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Volume 997c8bfa-d1dd-4da6-9522-0fd9aae4d92d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:18:37.808822 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Cloning 997c8bfa-d1dd-4da6-9522-0fd9aae4d92d from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:18:37.816881 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:37.826094 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 18, 37, 820849)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:18:37.826658 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:18:37.827141 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:18:37.831629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:37.832510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:18:37.838107 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 18, 37, 835773)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:18:37.838593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:18:37.838910 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:18:37.854466 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:37.925304 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] creating snapshot='volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:18:38.280968 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d.clone_snap' to 'volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:18:38.426833 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:38.428139 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:38.428533 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:38.446183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:18:38.448875 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Marking volume 997c8bfa-d1dd-4da6-9522-0fd9aae4d92d as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:18:38.456924 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 997c8bfa-d1dd-4da6-9522-0fd9aae4d92d. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:18:38.457397 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Creating volume glance metadata for volume 997c8bfa-d1dd-4da6-9522-0fd9aae4d92d backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:18:38.507694 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cfe233-2f4e-450b-8c10-56fc2825e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:38.510443 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91f469a-183e-450f-9d34-22eeb12d1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:38.518508 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Volume volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d (997c8bfa-d1dd-4da6-9522-0fd9aae4d92d): created successfully Nov 27 21:18:38.520897 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91f469a-183e-450f-9d34-22eeb12d1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:38.524516 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Flow 'volume_create_manager' (b3e20bb9-2e68-41d5-a41c-bfb8733c271d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:38.532205 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b0d8203e-db8b-41bf-8a1e-857796f68264 tempest-VolumesExtendTest-1922754726 None] Created volume successfully. Nov 27 21:18:38.830063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c752b185-b086-4c68-a43d-57247d371219 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:38.985466 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c752b185-b086-4c68-a43d-57247d371219 tempest-VolumesExtendTest-1922754726 None] Extend volume from 1 GB to 2 GB. {{(pid=129088) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Nov 27 21:18:39.012240 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c752b185-b086-4c68-a43d-57247d371219 tempest-VolumesExtendTest-1922754726 None] Extend volume completed successfully. Nov 27 21:18:40.241296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:40.245066 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:40.245504 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:40.257424 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Flow 'volume_create_manager' (0f7af122-932e-4d63-8d5b-ffca3a07637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:40.260768 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1250e8b1-6638-4571-bfc9-08cdc9b253df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.266759 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:40.281961 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1250e8b1-6638-4571-bfc9-08cdc9b253df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-140749272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=14628845-dca0-4756-b622-822ce8dcdcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a177f11d9942a8a518569075cf5578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:40Z,use_quota=True,user_id='756f825c3dca46609964845883f98077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.285225 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02da6428-5d8a-441a-b5f5-254d5bc5b009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.287632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02da6428-5d8a-441a-b5f5-254d5bc5b009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.289970 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2c2bf1-c610-458a-a529-55a100e01ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.292739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2c2bf1-c610-458a-a529-55a100e01ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14628845-dca0-4756-b622-822ce8dcdcbe', 'volume_name': 'volume-14628845-dca0-4756-b622-822ce8dcdcbe', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.295015 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8751e-2d4a-4bab-bff0-8754e5d15ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.297144 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8751e-2d4a-4bab-bff0-8754e5d15ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.299343 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55fa64a-7c54-4425-8293-3fa4931ba388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.300121 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Volume 14628845-dca0-4756-b622-822ce8dcdcbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14628845-dca0-4756-b622-822ce8dcdcbe', 'volume_size': 1} Nov 27 21:18:40.300511 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] creating volume 'volume-14628845-dca0-4756-b622-822ce8dcdcbe' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:40.301471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:40.348732 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:40.349112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:40.351125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55fa64a-7c54-4425-8293-3fa4931ba388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14628845-dca0-4756-b622-822ce8dcdcbe', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.353993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e57052-0ca4-4286-a02f-3bf90c794dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:40.362410 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Volume volume-14628845-dca0-4756-b622-822ce8dcdcbe (14628845-dca0-4756-b622-822ce8dcdcbe): created successfully Nov 27 21:18:40.364567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e57052-0ca4-4286-a02f-3bf90c794dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:40.367547 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Flow 'volume_create_manager' (0f7af122-932e-4d63-8d5b-ffca3a07637a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:40.374638 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ba17c400-5940-4b92-8380-78f1cbd69027 tempest-VolumesExtendTest-1922754726 None] Created volume successfully. Nov 27 21:18:41.451109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8e25199b-e759-436f-84da-23e3cadf97b9 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:42.260288 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8e25199b-e759-436f-84da-23e3cadf97b9 tempest-VolumesExtendTest-1922754726 None] Create snapshot completed successfully Nov 27 21:18:42.587485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0137417b-b0d8-42be-b014-9520c49a5e0f tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:42.692582 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0137417b-b0d8-42be-b014-9520c49a5e0f tempest-VolumesExtendTest-1922754726 None] Extend volume from 1 GB to 2 GB. {{(pid=129088) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Nov 27 21:18:42.720222 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0137417b-b0d8-42be-b014-9520c49a5e0f tempest-VolumesExtendTest-1922754726 None] Extend volume completed successfully. Nov 27 21:18:43.778714 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-963ca02c-e94a-4765-93ee-1482ddcccc5e tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-fac7f5c3-3da8-4a19-9202-52f2770b439d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:43.780219 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-963ca02c-e94a-4765-93ee-1482ddcccc5e tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:44.303993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-963ca02c-e94a-4765-93ee-1482ddcccc5e tempest-VolumesExtendTest-1922754726 None] Created reservations ['b63609c5-b593-4d12-9654-688f81a1c0dc', 'e46615ec-eb60-4c89-91a0-b6766d90d8cf', '08eb1aa0-865e-448e-af9a-c29c7b000754', '72a26bd9-9487-4bd1-9335-f77332c3a97e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:44.339129 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-963ca02c-e94a-4765-93ee-1482ddcccc5e tempest-VolumesExtendTest-1922754726 None] Delete snapshot completed successfully. Nov 27 21:18:44.343767 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-963ca02c-e94a-4765-93ee-1482ddcccc5e tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-fac7f5c3-3da8-4a19-9202-52f2770b439d-delete_snapshot'" released by "delete_snapshot" :: held 0.565s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:44.872417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-14628845-dca0-4756-b622-822ce8dcdcbe-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:44.912494 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:44.966783 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:44.967330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Volume volume-14628845-dca0-4756-b622-822ce8dcdcbe is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:44.973347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] deleting rbd volume volume-14628845-dca0-4756-b622-822ce8dcdcbe {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:45.231762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Created reservations ['df62380a-0da7-4334-880a-7b257c41b32d', 'f3578da9-c00f-4052-b13d-52a4cf5bed37', '8fcc6964-ce95-4b81-bd61-07360b6f5e7d', 'a5ff1834-412c-4934-b238-0298a56731c9'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:45.278436 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:45.312914 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:45.371705 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:45.380166 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Deleted volume successfully. Nov 27 21:18:45.397769 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5e5c97f6-c979-4ebb-a447-8f01e75585b1 tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-14628845-dca0-4756-b622-822ce8dcdcbe-delete_volume'" released by "delete_volume" :: held 0.525s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:45.996011 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:46.029682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:46.121994 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:46.135104 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] deleting rbd volume volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:46.385929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:18:46.427464 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] deleting parent snapshot volume-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:18:47.333862 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] Created reservations ['019b9fe3-1a6f-4c23-86cf-432a2983b078', '84c7c3eb-fa5e-410e-89b5-8b03bb4f08e0', 'd9cf7405-ac7a-40ba-aebe-35111bd52314', 'b54a8057-8510-4977-8d23-bcf5dbca4c31'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:47.375345 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:47.403175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:47.429255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:47.433358 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] Deleted volume successfully. Nov 27 21:18:47.448305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9b206758-6318-4394-84f3-0f068b81698c tempest-VolumesExtendTest-1922754726 None] Lock "b'cinder-997c8bfa-d1dd-4da6-9522-0fd9aae4d92d-delete_volume'" released by "delete_volume" :: held 1.452s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:49.995963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:49.999288 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:49.999741 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:50.013971 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (2a1961c6-e1a8-41f9-8596-3ec06241cf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:50.017462 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec056e-260f-4a01-a4b8-a8ea87948d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.023845 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:50.037699 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec056e-260f-4a01-a4b8-a8ea87948d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903663768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=674b1b98-2c8b-4157-9fee-8db949dea3b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f11c0a31ba3a4673a42499d8426c122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:50Z,use_quota=True,user_id='33d06d0e376348e1aee75912024ff556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.042025 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b9b21b-5231-45ab-9a27-6a6c593eda4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.044174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b9b21b-5231-45ab-9a27-6a6c593eda4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.046639 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab671d4-bf07-4c42-a9f1-6ec584e02261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.049513 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab671d4-bf07-4c42-a9f1-6ec584e02261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674b1b98-2c8b-4157-9fee-8db949dea3b5', 'volume_name': 'volume-674b1b98-2c8b-4157-9fee-8db949dea3b5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.051999 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be14622-c84a-4008-a747-895ad80a02c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.054103 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be14622-c84a-4008-a747-895ad80a02c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.056957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7b445-e0b3-45aa-bed5-0f01a2903dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.057730 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Volume 674b1b98-2c8b-4157-9fee-8db949dea3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674b1b98-2c8b-4157-9fee-8db949dea3b5', 'volume_size': 1} Nov 27 21:18:50.058118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] creating volume 'volume-674b1b98-2c8b-4157-9fee-8db949dea3b5' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:50.059124 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:50.127666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:50.128091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:50.130219 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7b445-e0b3-45aa-bed5-0f01a2903dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674b1b98-2c8b-4157-9fee-8db949dea3b5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.132619 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aa9f44-73c5-42d2-a848-92e263de35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:50.142339 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Volume volume-674b1b98-2c8b-4157-9fee-8db949dea3b5 (674b1b98-2c8b-4157-9fee-8db949dea3b5): created successfully Nov 27 21:18:50.144594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aa9f44-73c5-42d2-a848-92e263de35ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:50.147731 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (2a1961c6-e1a8-41f9-8596-3ec06241cf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:50.157004 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ef7f5dc0-0097-4c58-a220-20b28b617620 tempest-VolumesListTestJSON-1990985366 None] Created volume successfully. Nov 27 21:18:51.344970 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:51.348180 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:51.348622 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:51.362007 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (dd891440-7a07-4d80-abaf-8dde367f33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:51.365489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d2a08e-ec19-403b-9a60-91541fd86319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.372190 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:51.384835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d2a08e-ec19-403b-9a60-91541fd86319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1047808669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6032399f-8fc8-41aa-a8d8-5eb047456808,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f11c0a31ba3a4673a42499d8426c122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:51Z,use_quota=True,user_id='33d06d0e376348e1aee75912024ff556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.387429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74f797f-10fa-47c6-bf9e-df915d8790b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.389567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74f797f-10fa-47c6-bf9e-df915d8790b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.391993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c7ef9f-7a1d-4df3-aaa6-fbb78ec883ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.394231 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c7ef9f-7a1d-4df3-aaa6-fbb78ec883ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6032399f-8fc8-41aa-a8d8-5eb047456808', 'volume_name': 'volume-6032399f-8fc8-41aa-a8d8-5eb047456808', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.396548 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914f5b4-8861-4a98-b38f-1415a8007544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.398651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914f5b4-8861-4a98-b38f-1415a8007544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.401049 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0ef392-94e2-401c-bbe9-70ebc78c41aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.401824 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Volume 6032399f-8fc8-41aa-a8d8-5eb047456808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6032399f-8fc8-41aa-a8d8-5eb047456808', 'volume_size': 1} Nov 27 21:18:51.402215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] creating volume 'volume-6032399f-8fc8-41aa-a8d8-5eb047456808' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:51.403187 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:51.471541 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:51.471929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:51.473962 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0ef392-94e2-401c-bbe9-70ebc78c41aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6032399f-8fc8-41aa-a8d8-5eb047456808', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.476205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd0870-fbb5-456b-9c6c-63a4728aad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:51.485401 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Volume volume-6032399f-8fc8-41aa-a8d8-5eb047456808 (6032399f-8fc8-41aa-a8d8-5eb047456808): created successfully Nov 27 21:18:51.487442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd0870-fbb5-456b-9c6c-63a4728aad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:51.490685 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (dd891440-7a07-4d80-abaf-8dde367f33ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:51.499392 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-aa73baed-928e-4cd8-aa2f-517e8b0f73bc tempest-VolumesListTestJSON-1990985366 None] Created volume successfully. Nov 27 21:18:52.691936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:18:52.695202 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:18:52.695675 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:18:52.708125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (fa5f0125-a598-4607-b8f1-41251c3bd03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:52.712558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b5ba3b-4d50-4906-bf4e-78717bfa4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.718675 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:18:52.731619 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b5ba3b-4d50-4906-bf4e-78717bfa4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-54825318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19f0126e-744c-4729-90d2-3f108422c32f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f11c0a31ba3a4673a42499d8426c122d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:18:53Z,use_quota=True,user_id='33d06d0e376348e1aee75912024ff556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.734243 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eee2ce2-90da-4de0-aba9-24df30dabd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.736503 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eee2ce2-90da-4de0-aba9-24df30dabd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.739183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea102215-60ec-4fd1-b4ed-433b5783fd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.741451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea102215-60ec-4fd1-b4ed-433b5783fd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f0126e-744c-4729-90d2-3f108422c32f', 'volume_name': 'volume-19f0126e-744c-4729-90d2-3f108422c32f', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.744413 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e1151-c700-4600-9c90-9a1cb3fa50e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.746557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e1151-c700-4600-9c90-9a1cb3fa50e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.748829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d398e1-d86c-47cc-88bc-9991e5e21812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.749621 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Volume 19f0126e-744c-4729-90d2-3f108422c32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f0126e-744c-4729-90d2-3f108422c32f', 'volume_size': 1} Nov 27 21:18:52.750021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] creating volume 'volume-19f0126e-744c-4729-90d2-3f108422c32f' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:18:52.750993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:52.803313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:18:52.803747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:18:52.805911 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d398e1-d86c-47cc-88bc-9991e5e21812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f0126e-744c-4729-90d2-3f108422c32f', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.808653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1b4b7f-3ac5-4580-a007-b67c77c939e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:18:52.817873 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Volume volume-19f0126e-744c-4729-90d2-3f108422c32f (19f0126e-744c-4729-90d2-3f108422c32f): created successfully Nov 27 21:18:52.819711 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1b4b7f-3ac5-4580-a007-b67c77c939e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:18:52.822651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Flow 'volume_create_manager' (fa5f0125-a598-4607-b8f1-41251c3bd03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:18:52.829572 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-de39f5c5-b7ad-4d52-9236-8548ee02643c tempest-VolumesListTestJSON-1990985366 None] Created volume successfully. Nov 27 21:18:55.878886 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-19f0126e-744c-4729-90d2-3f108422c32f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:55.913043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:55.951112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:55.951572 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Volume volume-19f0126e-744c-4729-90d2-3f108422c32f is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:55.956510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] deleting rbd volume volume-19f0126e-744c-4729-90d2-3f108422c32f {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:56.176489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Created reservations ['2e9f3e4c-fad4-4d0d-a262-5a6d4b258fb4', '29985c89-9492-46aa-abc4-5386a3d29bbf', '3a8af3ed-f17f-4e70-85d9-d3b88edb3de4', '83d2e6e2-5869-4143-b501-2eadedfb5c83'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:56.221875 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:56.259664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:56.287409 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:56.292864 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Deleted volume successfully. Nov 27 21:18:56.303830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7f7e600e-d0b6-4599-b4b5-fc82961a9740 tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-19f0126e-744c-4729-90d2-3f108422c32f-delete_volume'" released by "delete_volume" :: held 0.425s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:56.996171 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-6032399f-8fc8-41aa-a8d8-5eb047456808-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:57.031987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:57.067883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:57.068342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Volume volume-6032399f-8fc8-41aa-a8d8-5eb047456808 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:57.075072 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] deleting rbd volume volume-6032399f-8fc8-41aa-a8d8-5eb047456808 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:57.286626 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Created reservations ['a4db7f0e-ed62-4854-a231-04b2766fb267', '986ca62d-f431-469a-a2f5-afe33ae3aab9', 'a2a53c70-2b9d-4888-99b4-8456719a063a', '5a9c38c1-7abb-4e15-a882-66da97507f3a'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:57.330466 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:57.353500 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:57.376266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:57.380198 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Deleted volume successfully. Nov 27 21:18:57.392351 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-210e3a8e-f8f4-42ec-ab86-f8f7514e0c2c tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-6032399f-8fc8-41aa-a8d8-5eb047456808-delete_volume'" released by "delete_volume" :: held 0.396s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:18:57.913348 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:18:57.913998 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:57.937385 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:57.958934 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:58.118530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-674b1b98-2c8b-4157-9fee-8db949dea3b5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:18:58.156846 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:58.186548 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:18:58.186932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Volume volume-674b1b98-2c8b-4157-9fee-8db949dea3b5 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:18:58.192114 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] deleting rbd volume volume-674b1b98-2c8b-4157-9fee-8db949dea3b5 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:18:58.398008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Created reservations ['83626f2e-cf02-4b68-bf10-f6ab4c143ddf', '7d7ae8cf-1053-42f1-8afb-5a4d73ff5e54', 'e8601830-9065-46fb-8246-eace18bd62bb', '403aea56-3173-4f8f-897b-b84a196fc3e3'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:18:58.444805 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:58.466514 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:18:58.488830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:18:58.493927 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Deleted volume successfully. Nov 27 21:18:58.504725 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b9dbbd5c-8777-4d3f-9d4e-36778eb982a0 tempest-VolumesListTestJSON-1990985366 None] Lock "b'cinder-674b1b98-2c8b-4157-9fee-8db949dea3b5-delete_volume'" released by "delete_volume" :: held 0.386s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:01.795847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:19:01.799108 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:19:01.799581 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:19:01.811650 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (9a17aef1-87da-47f5-8535-7221e3d71130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:01.814764 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925225b-0d49-434a-bb59-bc60b749d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.820822 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:19:01.835950 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925225b-0d49-434a-bb59-bc60b749d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-407836188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4f886f9-5e7d-4b5a-bdf9-24c0605166d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:19:02Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.839368 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f083805-0e31-4f6e-b908-97eef9961b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.841504 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f083805-0e31-4f6e-b908-97eef9961b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.843918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1ff0b-6a14-4a93-9d50-f6942df022c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.846122 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1ff0b-6a14-4a93-9d50-f6942df022c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'volume_name': 'volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.848448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29170f3b-dd2d-4371-9f73-cfd618e011f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.850580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29170f3b-dd2d-4371-9f73-cfd618e011f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.852838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb280bb-a778-4544-a2f1-43a834c66c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.853613 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Volume f4f886f9-5e7d-4b5a-bdf9-24c0605166d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'volume_size': 1} Nov 27 21:19:01.854003 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] creating volume 'volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:19:01.854966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:01.906573 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:19:01.906955 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:19:01.909105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb280bb-a778-4544-a2f1-43a834c66c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.911369 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c330f1ec-2e93-44ab-a00e-8d6fcffffd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:01.920043 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5 (f4f886f9-5e7d-4b5a-bdf9-24c0605166d5): created successfully Nov 27 21:19:01.921867 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c330f1ec-2e93-44ab-a00e-8d6fcffffd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:01.924868 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (9a17aef1-87da-47f5-8535-7221e3d71130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:01.931973 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-205059ad-5341-4248-b0b0-fc9fc99d648b tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:19:02.990728 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5fe57a06-9066-4249-8f16-bad132014d17 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:03.484250 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5fe57a06-9066-4249-8f16-bad132014d17 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:19:04.278188 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.driver [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Creating a new backup for volume volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5. {{(pid=129088) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Nov 27 21:19:04.309454 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] cloning volumes/volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5@snapshot-8ba87091-9c28-487a-a2a8-727c8531218a to volume-a898c726-eed0-40f8-b97e-53b5e8bac437 {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:19:04.310102 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:04.349586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:04.461715 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:19:04.462125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:19:04.491664 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:19:05.122846 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:19:05.123583 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a898c726-eed0-40f8-b97e-53b5e8bac437', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'a898c726-eed0-40f8-b97e-53b5e8bac437', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:19:05.140791 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Initialize volume connection completed successfully. Nov 27 21:19:13.094437 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Terminate volume connection completed successfully. Nov 27 21:19:13.109077 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Remove volume export completed successfully. Nov 27 21:19:13.148458 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-a898c726-eed0-40f8-b97e-53b5e8bac437-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:13.161475 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:13.215294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:19:13.222510 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-a898c726-eed0-40f8-b97e-53b5e8bac437 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:19:13.434142 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:19:13.439347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7fe07f7d-7332-4035-93bb-c399ff7e5c35 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-a898c726-eed0-40f8-b97e-53b5e8bac437-delete_volume'" released by "delete_volume" :: held 0.291s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:25.227680 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:19:25.231422 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:19:25.231932 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:19:25.245227 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (7739b8c1-d0ab-4573-a026-783a1c587c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:25.248528 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e4c11-1326-48ea-a2f1-42c000f05552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:25.254795 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:19:25.267788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e4c11-1326-48ea-a2f1-42c000f05552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076369817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=555cdd24-e7af-4c5f-85e7-abcbaa558327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:19:25Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:25.270571 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd6cca0-eaa6-4f94-bfc1-89e0a7865cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:25.272770 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd6cca0-eaa6-4f94-bfc1-89e0a7865cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:25.275917 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1697c9a3-4e2f-421b-adfa-30f7e14ae7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:25.352799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1697c9a3-4e2f-421b-adfa-30f7e14ae7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '555cdd24-e7af-4c5f-85e7-abcbaa558327', 'volume_name': 'volume-555cdd24-e7af-4c5f-85e7-abcbaa558327', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:25.355374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021bcbeb-d6d9-4547-a49d-7213373675c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:25.357602 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021bcbeb-d6d9-4547-a49d-7213373675c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:25.359859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c106f6d-744f-4808-9689-ceac558b2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:25.360701 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Volume 555cdd24-e7af-4c5f-85e7-abcbaa558327: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-555cdd24-e7af-4c5f-85e7-abcbaa558327', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:19:25.361278 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Cloning 555cdd24-e7af-4c5f-85e7-abcbaa558327 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:19:25.370219 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:25.379794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 19, 25, 374163)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:19:25.380236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:19:25.380633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:19:25.385236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:25.386164 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:19:25.391953 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 19, 25, 389700)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:19:25.392354 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:19:25.392747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:19:25.405467 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:25.467111 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] creating snapshot='volume-555cdd24-e7af-4c5f-85e7-abcbaa558327.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:19:26.467033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-555cdd24-e7af-4c5f-85e7-abcbaa558327.clone_snap' to 'volume-555cdd24-e7af-4c5f-85e7-abcbaa558327' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:19:26.584303 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:19:26.585434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:19:26.586427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:19:26.601485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:19:26.602153 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Marking volume 555cdd24-e7af-4c5f-85e7-abcbaa558327 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:19:26.609419 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 555cdd24-e7af-4c5f-85e7-abcbaa558327. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:19:26.609845 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Creating volume glance metadata for volume 555cdd24-e7af-4c5f-85e7-abcbaa558327 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:19:26.657101 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c106f6d-744f-4808-9689-ceac558b2141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555cdd24-e7af-4c5f-85e7-abcbaa558327', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:26.659295 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16882922-f778-427b-b713-61b736b5aeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:26.666357 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-555cdd24-e7af-4c5f-85e7-abcbaa558327 (555cdd24-e7af-4c5f-85e7-abcbaa558327): created successfully Nov 27 21:19:26.668247 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16882922-f778-427b-b713-61b736b5aeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:26.671146 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (7739b8c1-d0ab-4573-a026-783a1c587c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:26.677755 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7d699082-b244-46da-b0e2-6a9399ea35ee tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:19:27.680635 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-fbcfad7d-3995-493f-af47-09a4c74b6c99 req-5466fa34-2173-4635-8949-b2c9b6846561 tempest-VolumesSnapshotTestJSON-481511107 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:19:28.375006 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-fbcfad7d-3995-493f-af47-09a4c74b6c99 req-5466fa34-2173-4635-8949-b2c9b6846561 tempest-VolumesSnapshotTestJSON-481511107 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.694s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:19:28.375835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fbcfad7d-3995-493f-af47-09a4c74b6c99 req-5466fa34-2173-4635-8949-b2c9b6846561 tempest-VolumesSnapshotTestJSON-481511107 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-555cdd24-e7af-4c5f-85e7-abcbaa558327', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '555cdd24-e7af-4c5f-85e7-abcbaa558327', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:19:28.397693 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-fbcfad7d-3995-493f-af47-09a4c74b6c99 req-5466fa34-2173-4635-8949-b2c9b6846561 tempest-VolumesSnapshotTestJSON-481511107 None] Connection info returned from driver {'name': 'volumes/volume-555cdd24-e7af-4c5f-85e7-abcbaa558327', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '555cdd24-e7af-4c5f-85e7-abcbaa558327', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'af761198-4d7e-4a02-978b-7d0b7491fa35'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:19:28.444691 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-fbcfad7d-3995-493f-af47-09a4c74b6c99 req-5466fa34-2173-4635-8949-b2c9b6846561 tempest-VolumesSnapshotTestJSON-481511107 None] attachment_update completed successfully. Nov 27 21:19:30.984080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:19:30.987806 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:19:30.988552 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:19:31.002189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (85d1710b-1507-4390-bc50-57d13232dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:31.005526 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025555a9-f286-4c6c-9b52-eeb5a45e724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.015394 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:19:31.029159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025555a9-f286-4c6c-9b52-eeb5a45e724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1353529444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f5833fc-8042-4440-996a-f4d1f028c3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219be90852c0481aaad9862d1a485102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:19:31Z,use_quota=True,user_id='b771da0354414b239da0cad505f8ffe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.031963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c48b792-c49e-4ff6-833a-7dcd82edc39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.034080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c48b792-c49e-4ff6-833a-7dcd82edc39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.036530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b0608-5888-4409-aec5-4039c9ad9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.039306 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b0608-5888-4409-aec5-4039c9ad9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5833fc-8042-4440-996a-f4d1f028c3c8', 'volume_name': 'volume-5f5833fc-8042-4440-996a-f4d1f028c3c8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.041598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445ef338-5bef-4ded-9473-4a877f9eb9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.043747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445ef338-5bef-4ded-9473-4a877f9eb9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.045940 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85b8516-7149-4048-b1a6-9a8da57bd844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.046716 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Volume 5f5833fc-8042-4440-996a-f4d1f028c3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5833fc-8042-4440-996a-f4d1f028c3c8', 'volume_size': 1} Nov 27 21:19:31.047115 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] creating volume 'volume-5f5833fc-8042-4440-996a-f4d1f028c3c8' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:19:31.048211 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:31.086192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-50398df6-44ad-4b77-ac30-84e23e906d30 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:31.149647 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:19:31.150098 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:19:31.152440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85b8516-7149-4048-b1a6-9a8da57bd844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5833fc-8042-4440-996a-f4d1f028c3c8', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.155422 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ff5a44-e157-4582-bdbe-71e2cfb94866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:31.164610 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-5f5833fc-8042-4440-996a-f4d1f028c3c8 (5f5833fc-8042-4440-996a-f4d1f028c3c8): created successfully Nov 27 21:19:31.166461 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ff5a44-e157-4582-bdbe-71e2cfb94866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:31.169702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (85d1710b-1507-4390-bc50-57d13232dde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:31.177002 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-606105a3-ed3f-4751-8110-72a8852fbbbf tempest-AttachVolumeTestJSON-1651489591 None] Created volume successfully. Nov 27 21:19:31.573622 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-50398df6-44ad-4b77-ac30-84e23e906d30 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:19:32.167746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cf00f49c-4b51-40c4-8ddb-e6a9f08af8fc tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:32.423166 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f req-198dbef9-6233-47bb-9d96-84551c24c3cc tempest-AttachVolumeTestJSON-1651489591 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:19:32.588778 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cf00f49c-4b51-40c4-8ddb-e6a9f08af8fc tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:19:33.074619 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f req-198dbef9-6233-47bb-9d96-84551c24c3cc tempest-AttachVolumeTestJSON-1651489591 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:19:33.075339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f req-198dbef9-6233-47bb-9d96-84551c24c3cc tempest-AttachVolumeTestJSON-1651489591 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5f5833fc-8042-4440-996a-f4d1f028c3c8', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '5f5833fc-8042-4440-996a-f4d1f028c3c8', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:19:33.094351 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f req-198dbef9-6233-47bb-9d96-84551c24c3cc tempest-AttachVolumeTestJSON-1651489591 None] Connection info returned from driver {'name': 'volumes/volume-5f5833fc-8042-4440-996a-f4d1f028c3c8', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5f5833fc-8042-4440-996a-f4d1f028c3c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '06be7143-9377-4f89-abda-a9520132a76c'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:19:33.139206 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f req-198dbef9-6233-47bb-9d96-84551c24c3cc tempest-AttachVolumeTestJSON-1651489591 None] attachment_update completed successfully. Nov 27 21:19:33.380437 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f3ff924c-64e7-438c-afa2-6b186c0ac1d1 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:33.583307 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f3ff924c-64e7-438c-afa2-6b186c0ac1d1 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:19:34.427935 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cde9660a-1f57-4306-b903-322bf8f5dee6 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-7236e25a-f6d2-4136-884f-1e1a32a799d8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:34.429465 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-cde9660a-1f57-4306-b903-322bf8f5dee6 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:35.887717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:19:35.891706 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:19:35.892193 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:19:35.905048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (1a474908-698e-4dbc-94e0-f7bdf175ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:35.908297 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5d230-c784-400b-9715-067188e1e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:35.914706 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:19:35.926713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a5d230-c784-400b-9715-067188e1e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-16392973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cafa9637-d149-456a-b338-409aa272aa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219be90852c0481aaad9862d1a485102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:19:36Z,use_quota=True,user_id='b771da0354414b239da0cad505f8ffe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:35.929267 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf45a60e-b893-44d3-9564-2cc69ddaf611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:35.931398 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf45a60e-b893-44d3-9564-2cc69ddaf611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:35.933757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ead4fc-dcfd-42b9-8fa7-8573dd64b718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:35.935985 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ead4fc-dcfd-42b9-8fa7-8573dd64b718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cafa9637-d149-456a-b338-409aa272aa0b', 'volume_name': 'volume-cafa9637-d149-456a-b338-409aa272aa0b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:35.938249 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728cf963-81b9-4a77-a3fa-cff51e1bd9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:35.940352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728cf963-81b9-4a77-a3fa-cff51e1bd9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:35.942517 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659be3b2-07aa-42de-b9ef-0e2e9dca3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:35.943294 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Volume cafa9637-d149-456a-b338-409aa272aa0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cafa9637-d149-456a-b338-409aa272aa0b', 'volume_size': 1} Nov 27 21:19:35.943693 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] creating volume 'volume-cafa9637-d149-456a-b338-409aa272aa0b' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:19:35.944664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:35.994132 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:19:35.994520 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:19:35.996586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659be3b2-07aa-42de-b9ef-0e2e9dca3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cafa9637-d149-456a-b338-409aa272aa0b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:35.998717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98462075-a2ef-4fea-bbbf-53668df27ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:19:36.007157 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-cafa9637-d149-456a-b338-409aa272aa0b (cafa9637-d149-456a-b338-409aa272aa0b): created successfully Nov 27 21:19:36.008966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98462075-a2ef-4fea-bbbf-53668df27ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:19:36.011914 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Flow 'volume_create_manager' (1a474908-698e-4dbc-94e0-f7bdf175ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:19:36.018890 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d210d13d-375d-41a6-aad9-99319e22db1e tempest-AttachVolumeTestJSON-1651489591 None] Created volume successfully. Nov 27 21:19:37.316084 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 req-200c7136-27b5-4981-8281-74b6452bd37b tempest-AttachVolumeTestJSON-1651489591 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:19:37.952986 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 req-200c7136-27b5-4981-8281-74b6452bd37b tempest-AttachVolumeTestJSON-1651489591 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.637s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:19:37.953792 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 req-200c7136-27b5-4981-8281-74b6452bd37b tempest-AttachVolumeTestJSON-1651489591 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cafa9637-d149-456a-b338-409aa272aa0b', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'cafa9637-d149-456a-b338-409aa272aa0b', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:19:37.976798 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 req-200c7136-27b5-4981-8281-74b6452bd37b tempest-AttachVolumeTestJSON-1651489591 None] Connection info returned from driver {'name': 'volumes/volume-cafa9637-d149-456a-b338-409aa272aa0b', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cafa9637-d149-456a-b338-409aa272aa0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f0b3dace-de6d-464d-8404-56f53241932f'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:19:38.020867 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 req-200c7136-27b5-4981-8281-74b6452bd37b tempest-AttachVolumeTestJSON-1651489591 None] attachment_update completed successfully. Nov 27 21:19:41.522800 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-017f2cb5-081b-4054-a8c5-626a5baf9e31 req-f2bf0bdc-6aad-4ffe-a1f0-c661eef6a4bb tempest-AttachVolumeTestJSON-1651489591 None] Terminate volume connection completed successfully. Nov 27 21:19:41.523462 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-017f2cb5-081b-4054-a8c5-626a5baf9e31 req-f2bf0bdc-6aad-4ffe-a1f0-c661eef6a4bb tempest-AttachVolumeTestJSON-1651489591 None] Deleting attachment 06be7143-9377-4f89-abda-a9520132a76c. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:19:42.893720 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-68de628b-f672-46d3-85dd-b128b04971ce req-f2f6d07d-fe69-4130-9778-327b6023fc8a tempest-AttachVolumeTestJSON-1651489591 None] Terminate volume connection completed successfully. Nov 27 21:19:42.894363 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-68de628b-f672-46d3-85dd-b128b04971ce req-f2f6d07d-fe69-4130-9778-327b6023fc8a tempest-AttachVolumeTestJSON-1651489591 None] Deleting attachment f0b3dace-de6d-464d-8404-56f53241932f. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:19:48.771997 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-cafa9637-d149-456a-b338-409aa272aa0b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:48.822632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:48.879951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:19:48.880687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-cafa9637-d149-456a-b338-409aa272aa0b is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:19:48.886878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] deleting rbd volume volume-cafa9637-d149-456a-b338-409aa272aa0b {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:19:49.109222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Created reservations ['84a81eb0-0dbf-406e-bea2-7f1980664eb9', '9ada9ec1-34b4-4c48-9bc4-1382391876a9', '2659dbab-4bd0-44dd-84a3-8131fe969339', '7b654b77-4c79-415d-8dbe-0c5539e4b109'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:19:49.161533 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:49.190837 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:49.217204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:19:49.222918 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Deleted volume successfully. Nov 27 21:19:49.245350 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e80d587d-45dc-4c37-a933-c2580ce72fbe tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-cafa9637-d149-456a-b338-409aa272aa0b-delete_volume'" released by "delete_volume" :: held 0.473s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:49.903092 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-5f5833fc-8042-4440-996a-f4d1f028c3c8-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:49.949967 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:49.991918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:19:49.992428 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-5f5833fc-8042-4440-996a-f4d1f028c3c8 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:19:49.999502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] deleting rbd volume volume-5f5833fc-8042-4440-996a-f4d1f028c3c8 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:19:50.211438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Created reservations ['5d9bc08e-459f-40bb-91d6-6a7f5b3f0f6d', '463ebd56-259d-471c-8cf1-c632bc15d78a', '3eec3e9e-eb03-4f87-9f1a-8dda49aa767b', '0dada24e-4734-452a-8312-3d033b134caf'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:19:50.260780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:50.293927 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:50.326861 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:19:50.333637 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Deleted volume successfully. Nov 27 21:19:50.347107 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9d70d3f1-5b99-4db3-ba01-493d0b512355 tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-5f5833fc-8042-4440-996a-f4d1f028c3c8-delete_volume'" released by "delete_volume" :: held 0.444s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:51.098655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-62a70256-eb0c-4887-87f1-84cf766abe3c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:19:51.128631 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:51.167857 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:19:51.168286 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Volume volume-62a70256-eb0c-4887-87f1-84cf766abe3c is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:19:51.172863 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] deleting rbd volume volume-62a70256-eb0c-4887-87f1-84cf766abe3c {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:19:51.373833 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Created reservations ['6d4844bc-f166-468a-b0dd-bac12aa1f4d8', '246f27c6-0a2e-4bbd-8281-324e18362bcf', '59effa4e-b048-43c8-87ae-7f37a6f47e86', '78f53db8-cdff-4158-8f15-0399ee51e44d'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:19:51.414304 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:51.440241 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:51.461803 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:19:51.465801 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Deleted volume successfully. Nov 27 21:19:51.478090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9b4c4b06-3adf-4593-95b6-848180c3feed tempest-AttachVolumeTestJSON-1651489591 None] Lock "b'cinder-62a70256-eb0c-4887-87f1-84cf766abe3c-delete_volume'" released by "delete_volume" :: held 0.380s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:19:57.915044 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:19:57.915813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:57.941677 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:19:57.993971 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:20:04.612638 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-cde9660a-1f57-4306-b903-322bf8f5dee6 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['1dd8bddf-f540-4fc7-b2e2-e1b9577d535f', '6cb02f00-f8eb-4bab-9fbf-dd2ff2b7ad49', '9630b361-ce83-4e04-893e-34da5585da9e', '27b11bb0-0a45-4621-9c67-e8361fb2018c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:20:04.664512 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-cde9660a-1f57-4306-b903-322bf8f5dee6 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:20:04.670621 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-cde9660a-1f57-4306-b903-322bf8f5dee6 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-7236e25a-f6d2-4136-884f-1e1a32a799d8-delete_snapshot'" released by "delete_snapshot" :: held 30.243s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:20:05.494696 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eb5d0dfd-e55d-4fc1-9c43-70a5a04069d1 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-64d1b81d-74dc-4235-8394-e5995a4b28fb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:20:05.498236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eb5d0dfd-e55d-4fc1-9c43-70a5a04069d1 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:20:35.708226 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-eb5d0dfd-e55d-4fc1-9c43-70a5a04069d1 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['c58ea43a-f74d-491f-8aa1-b89b04f0a8aa', '61884fbf-e6c1-4e45-9030-859990ff825d', '51ace7ce-2fa6-4cf3-b20c-bc39d986ee34', '7028edab-9dcd-4191-ad73-4ce11bc98244'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:20:35.746072 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-eb5d0dfd-e55d-4fc1-9c43-70a5a04069d1 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:20:35.750875 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eb5d0dfd-e55d-4fc1-9c43-70a5a04069d1 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-64d1b81d-74dc-4235-8394-e5995a4b28fb-delete_snapshot'" released by "delete_snapshot" :: held 30.256s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:20:36.393901 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-44f97f37-2d15-4323-a7e4-91e3f718e13d tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-009d7e8b-6c31-4352-91f0-cce6ca4caf54-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:20:36.395787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-44f97f37-2d15-4323-a7e4-91e3f718e13d tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:20:57.918449 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:20:57.919346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:20:57.948435 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:20:57.979716 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:21:06.576471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-44f97f37-2d15-4323-a7e4-91e3f718e13d tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['f6fb11d5-06ad-4b57-816e-8acef3aaaba2', '73a07e64-7117-4ea2-88d1-09e225ce0da4', '069e3195-78c6-463b-b6f1-d9d5fbbadbb7', '2be49b94-fb90-4a05-ad21-2da737f37daf'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:21:06.633372 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-44f97f37-2d15-4323-a7e4-91e3f718e13d tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:21:06.639414 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-44f97f37-2d15-4323-a7e4-91e3f718e13d tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-009d7e8b-6c31-4352-91f0-cce6ca4caf54-delete_snapshot'" released by "delete_snapshot" :: held 30.245s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:21:08.188942 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 req-09bd3647-f1e8-4e17-bfec-918b2d1da1e3 tempest-VolumesSnapshotTestJSON-481511107 None] Terminate volume connection completed successfully. Nov 27 21:21:08.189598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 req-09bd3647-f1e8-4e17-bfec-918b2d1da1e3 tempest-VolumesSnapshotTestJSON-481511107 None] Deleting attachment af761198-4d7e-4a02-978b-7d0b7491fa35. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:21:12.918416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-d57c409d-e04d-42c2-ab63-2d9873a361e3 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:13.622134 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-d57c409d-e04d-42c2-ab63-2d9873a361e3 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:21:14.106492 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1b77d091-6fec-4288-b751-6ca5e1a50f49 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-a77a3387-59b1-4528-abb7-4bf1fc9a59b0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:21:14.107991 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1b77d091-6fec-4288-b751-6ca5e1a50f49 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:14.711376 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-1b77d091-6fec-4288-b751-6ca5e1a50f49 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['15a97584-5e29-4349-841c-acdb6bcdfceb', 'edc5fb04-36c4-42e4-a8d8-b2f5b741341b', 'f66e4b8d-4cd2-4ad1-be51-d6e458a8777a', 'db5918ad-8c16-4148-bf67-356dc88baf90'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:21:14.776275 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1b77d091-6fec-4288-b751-6ca5e1a50f49 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:21:14.784587 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-1b77d091-6fec-4288-b751-6ca5e1a50f49 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-a77a3387-59b1-4528-abb7-4bf1fc9a59b0-delete_snapshot'" released by "delete_snapshot" :: held 0.678s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:21:15.479706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8f53a1f4-cff7-48ae-89e8-56660aac70b4 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:16.479999 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8f53a1f4-cff7-48ae-89e8-56660aac70b4 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:21:32.153772 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 req-d464469d-1fcf-4be3-b2d0-8dda03c03a49 tempest-VolumesSnapshotTestJSON-481511107 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:21:32.896011 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 req-d464469d-1fcf-4be3-b2d0-8dda03c03a49 tempest-VolumesSnapshotTestJSON-481511107 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.745s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:21:32.897173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 req-d464469d-1fcf-4be3-b2d0-8dda03c03a49 tempest-VolumesSnapshotTestJSON-481511107 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:21:32.927036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 req-d464469d-1fcf-4be3-b2d0-8dda03c03a49 tempest-VolumesSnapshotTestJSON-481511107 None] Connection info returned from driver {'name': 'volumes/volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f4f886f9-5e7d-4b5a-bdf9-24c0605166d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '21dcb76c-d937-4804-829f-c6d48467007e'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:21:33.029482 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 req-d464469d-1fcf-4be3-b2d0-8dda03c03a49 tempest-VolumesSnapshotTestJSON-481511107 None] attachment_update completed successfully. Nov 27 21:21:35.316217 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1373a310-b192-4b67-9377-e45706e8975a tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:36.439162 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1373a310-b192-4b67-9377-e45706e8975a tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:21:37.602206 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b4b942ff-6cd0-486f-b446-4ccd151df514 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:38.483853 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b4b942ff-6cd0-486f-b446-4ccd151df514 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:21:38.667457 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4e142a93-2600-41ea-ac4d-449c3056e314 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-2a01c24d-e0f5-433f-b583-14ec47d7d427-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:21:38.669813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4e142a93-2600-41ea-ac4d-449c3056e314 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:57.922005 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:21:57.922879 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:57.947027 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:21:57.976067 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:05.131076 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:05.134708 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:05.135192 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:05.147493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Flow 'volume_create_manager' (c55578ba-2be9-4833-8f83-5c3551977161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:05.152772 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61529ed-19e9-443f-83d1-865852dae4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.158872 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:05.171122 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61529ed-19e9-443f-83d1-865852dae4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-919998290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=509159d4-d28f-4042-993c-7d1851daac63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a678c9fa11094a40859ce2b9c2785995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:05Z,use_quota=True,user_id='8d1bdfa8d45949a5b82045e1a09855aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.174222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c32ed7-a349-4606-b449-d11ea3146f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.176420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c32ed7-a349-4606-b449-d11ea3146f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.178811 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc77926-e649-4864-bb9a-e7dbeb59a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.181062 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc77926-e649-4864-bb9a-e7dbeb59a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509159d4-d28f-4042-993c-7d1851daac63', 'volume_name': 'volume-509159d4-d28f-4042-993c-7d1851daac63', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.183433 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ea7fdd-ed80-4e81-9de2-c5127553c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.185527 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ea7fdd-ed80-4e81-9de2-c5127553c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.187761 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a28c2f-b1c4-4eae-97d5-e49fd972e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.188536 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Volume 509159d4-d28f-4042-993c-7d1851daac63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509159d4-d28f-4042-993c-7d1851daac63', 'volume_size': 1} Nov 27 21:22:05.188999 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] creating volume 'volume-509159d4-d28f-4042-993c-7d1851daac63' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:05.190535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:05.238747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:05.239152 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:05.241176 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a28c2f-b1c4-4eae-97d5-e49fd972e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509159d4-d28f-4042-993c-7d1851daac63', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.243425 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7002638-c48c-42ca-a280-8b4acbba37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:05.252668 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Volume volume-509159d4-d28f-4042-993c-7d1851daac63 (509159d4-d28f-4042-993c-7d1851daac63): created successfully Nov 27 21:22:05.254507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7002638-c48c-42ca-a280-8b4acbba37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:05.257509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Flow 'volume_create_manager' (c55578ba-2be9-4833-8f83-5c3551977161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:05.264414 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5ae26674-83cb-4efc-8940-d74406f1c3e4 tempest-VolumeQuotasNegativeTestJSON-257774082 None] Created volume successfully. Nov 27 21:22:06.776094 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Lock "b'cinder-509159d4-d28f-4042-993c-7d1851daac63-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:06.806683 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:06.844198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:06.844727 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Volume volume-509159d4-d28f-4042-993c-7d1851daac63 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:06.850431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] deleting rbd volume volume-509159d4-d28f-4042-993c-7d1851daac63 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:07.048141 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Created reservations ['bd4f119d-13f4-4e4d-adfa-165ad874b271', 'f69268f4-66b9-42d9-87a3-6bb4a44a9a21', 'f7c47161-0d58-4f7e-9a8e-e33983524d55', 'fbecc187-ac3b-4ed5-a690-955f99669868'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:07.088830 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:07.109452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:07.131108 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:07.135470 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Deleted volume successfully. Nov 27 21:22:07.148118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-9fa0afa3-1b9c-44bb-89a4-f50877e06d4c tempest-VolumeQuotasNegativeTestJSON-257774082 None] Lock "b'cinder-509159d4-d28f-4042-993c-7d1851daac63-delete_volume'" released by "delete_volume" :: held 0.372s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:08.804628 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-4e142a93-2600-41ea-ac4d-449c3056e314 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['f979bde3-d0fc-4c97-be36-011271dee96f', '25a97293-1ba6-4c7c-b541-1b613f6dca15', '2c522d7d-6b81-4dcc-9ac8-bd32ad707159', '8ce5124f-9da7-4f0d-96e6-44ca573711a6'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:08.844540 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4e142a93-2600-41ea-ac4d-449c3056e314 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:22:08.851153 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4e142a93-2600-41ea-ac4d-449c3056e314 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-2a01c24d-e0f5-433f-b583-14ec47d7d427-delete_snapshot'" released by "delete_snapshot" :: held 30.184s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:09.634557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b553048a-d410-4974-97a8-da8ea436334c tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-94cfb469-0784-449a-b5b4-1921fb57b009-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:09.637000 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b553048a-d410-4974-97a8-da8ea436334c tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:10.848235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:10.851501 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:10.851955 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:10.864434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Flow 'volume_create_manager' (bc06f676-fac3-4cea-9053-59c5a7dc4971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:10.867653 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c58b7d1-96be-4a5c-9c17-3735169efda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.874062 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:10.887461 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c58b7d1-96be-4a5c-9c17-3735169efda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1011064351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4ec5f8f-ec91-4093-9ab9-03589e9c9314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570d7cfeaedb482dabbcfc5f93d933a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:11Z,use_quota=True,user_id='fb3d11de786246cd9850d272f063cb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f585d7f0-7aec-439c-8ea3-1fb3bc6d9bc8),volume_type_id=f585d7f0-7aec-439c-8ea3-1fb3bc6d9bc8)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.890089 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385819c0-9159-4435-b1fa-176ca49fe166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.892416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385819c0-9159-4435-b1fa-176ca49fe166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.895471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fdb248-c6e8-4022-8f12-a420a7d39b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.897699 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fdb248-c6e8-4022-8f12-a420a7d39b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ec5f8f-ec91-4093-9ab9-03589e9c9314', 'volume_name': 'volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.900066 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6bbeb8-b664-4177-bd76-57af191fb374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.902198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6bbeb8-b664-4177-bd76-57af191fb374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.904442 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5613b30b-7716-4f63-897a-36b08c22330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.905217 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Volume d4ec5f8f-ec91-4093-9ab9-03589e9c9314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314', 'volume_size': 1} Nov 27 21:22:10.905612 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] creating volume 'volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:10.906578 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:10.953966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:10.954346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:10.956384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5613b30b-7716-4f63-897a-36b08c22330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.959218 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d369ea-4751-4b06-b2d5-51e8f169d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:10.967737 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Volume volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314 (d4ec5f8f-ec91-4093-9ab9-03589e9c9314): created successfully Nov 27 21:22:10.969537 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d369ea-4751-4b06-b2d5-51e8f169d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:10.972527 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Flow 'volume_create_manager' (bc06f676-fac3-4cea-9053-59c5a7dc4971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:10.979703 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-537e9639-5242-47b4-bf67-0aea88c1c738 tempest-VolumeTypesTest-84603823 None] Created volume successfully. Nov 27 21:22:12.091070 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-510c2a16-b65a-4de8-9bbb-3b8c169128e2 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:12.112042 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-510c2a16-b65a-4de8-9bbb-3b8c169128e2 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:12.138021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-510c2a16-b65a-4de8-9bbb-3b8c169128e2 tempest-VolumeTypesTest-84603823 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:12.141889 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-510c2a16-b65a-4de8-9bbb-3b8c169128e2 tempest-VolumeTypesTest-84603823 None] Retype volume completed successfully. Nov 27 21:22:13.886083 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Lock "b'cinder-d4ec5f8f-ec91-4093-9ab9-03589e9c9314-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:13.918308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:13.953589 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:13.954021 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Volume volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:13.960339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] deleting rbd volume volume-d4ec5f8f-ec91-4093-9ab9-03589e9c9314 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:14.132894 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1498835328 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1498835328, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:22:14.133570 ncdv-master-1 cinder-volume[129088]: WARNING cinder.quota [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1498835328 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1498835328, it is now deprecated. Please use the default quota class for default quota. Nov 27 21:22:14.147451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Created reservations ['83a8f0ff-f161-487b-9048-c3a42f1e23f2', 'bd32368f-12bf-4afb-8674-7362e126e1c0', '34940819-30ba-4f14-ad7f-7bae6c7a1682', 'e80e6dee-cf7c-4f6a-a8fb-a06363242900'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:14.185766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:14.207081 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:14.228707 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:14.232673 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Deleted volume successfully. Nov 27 21:22:14.244891 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a55597b9-cf8c-4ecb-b2f4-c8d3405cf213 tempest-VolumeTypesTest-84603823 None] Lock "b'cinder-d4ec5f8f-ec91-4093-9ab9-03589e9c9314-delete_volume'" released by "delete_volume" :: held 0.359s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:32.632739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:32.635992 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:32.636441 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:32.648199 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (2cd0b381-96bc-4843-8a7c-a1b4a76c366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:32.651681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3c3841-41be-49df-a519-25791d1d0944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.657642 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:32.670247 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3c3841-41be-49df-a519-25791d1d0944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1776697119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fa23a4f1-c79b-4d46-b067-c0fb6d614060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:33Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.672878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aef7dd1-07e0-4711-bc77-5e4924b7a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.675716 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aef7dd1-07e0-4711-bc77-5e4924b7a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.678516 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2633d8af-de58-4e59-a68a-a95e25554128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.681469 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2633d8af-de58-4e59-a68a-a95e25554128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa23a4f1-c79b-4d46-b067-c0fb6d614060', 'volume_name': 'volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.685151 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b19b892-1b65-464b-82d0-c4987f7249f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.687376 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b19b892-1b65-464b-82d0-c4987f7249f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.689686 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4192a371-9e71-46dc-8688-d7314ebe3a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.690480 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Volume fa23a4f1-c79b-4d46-b067-c0fb6d614060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060', 'volume_size': 1} Nov 27 21:22:32.690879 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:32.691888 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:32.739787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:32.740102 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:32.742125 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4192a371-9e71-46dc-8688-d7314ebe3a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.744410 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f0d7b1-003c-4c0c-a6f1-452410dd51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:32.752853 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Volume volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060 (fa23a4f1-c79b-4d46-b067-c0fb6d614060): created successfully Nov 27 21:22:32.754682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f0d7b1-003c-4c0c-a6f1-452410dd51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:32.757677 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (2cd0b381-96bc-4843-8a7c-a1b4a76c366f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:32.764789 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8a439c35-2525-40f5-8ae5-2b8372c1fbe9 tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:33.685976 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3eca233a-67b1-4349-bc20-97270fa37b3b tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060'" acquired by "attach_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:33.721542 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3eca233a-67b1-4349-bc20-97270fa37b3b tempest-VolumesActionsTest-1294016791 None] Attaching volume fa23a4f1-c79b-4d46-b067-c0fb6d614060 to instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf at mountpoint /dev/sdb on host None. Nov 27 21:22:33.743397 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3eca233a-67b1-4349-bc20-97270fa37b3b tempest-VolumesActionsTest-1294016791 None] Attach volume completed successfully. Nov 27 21:22:33.747907 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3eca233a-67b1-4349-bc20-97270fa37b3b tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060'" released by "attach_volume" :: held 0.062s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:34.112587 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3583b610-1ad0-4d0f-8d66-4625de5133de tempest-VolumesActionsTest-1903701307 None] Terminate volume connection completed successfully. Nov 27 21:22:34.140956 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3583b610-1ad0-4d0f-8d66-4625de5133de tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:34.151829 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3583b610-1ad0-4d0f-8d66-4625de5133de tempest-VolumesActionsTest-1903701307 None] Detaching volume fa23a4f1-c79b-4d46-b067-c0fb6d614060 from instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf. Nov 27 21:22:34.179403 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3583b610-1ad0-4d0f-8d66-4625de5133de tempest-VolumesActionsTest-1903701307 None] Detach volume completed successfully. Nov 27 21:22:34.183656 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-3583b610-1ad0-4d0f-8d66-4625de5133de tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-detach_volume'" released by "detach_volume" :: held 0.043s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:34.323307 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-588b84e6-be3c-469d-bd8e-4e89a42bbcbb tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:34.323804 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-588b84e6-be3c-469d-bd8e-4e89a42bbcbb tempest-VolumesActionsTest-1294016791 None] Volume detach called, but volume not attached. Nov 27 21:22:34.338287 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-588b84e6-be3c-469d-bd8e-4e89a42bbcbb tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-detach_volume'" released by "detach_volume" :: held 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:37.182185 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:37.185577 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:37.186022 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:37.198702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (34331bdb-c208-4d32-b6f1-41c4d04a75ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:37.201893 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37ab002-c945-46a9-a601-35585b4a6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.208536 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:37.220634 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37ab002-c945-46a9-a601-35585b4a6da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1553581046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3d01422-9287-4c5f-aff6-34f806ec97c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:37Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.223271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afeb715-c348-4b3b-bb1d-d7d7acd0b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.225555 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afeb715-c348-4b3b-bb1d-d7d7acd0b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.228008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b33aa94-8674-482c-a8d0-b3ece1c6be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.230247 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b33aa94-8674-482c-a8d0-b3ece1c6be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d01422-9287-4c5f-aff6-34f806ec97c4', 'volume_name': 'volume-b3d01422-9287-4c5f-aff6-34f806ec97c4', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.232589 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0386d3aa-3f60-45cc-925c-bc4048c3add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.234718 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0386d3aa-3f60-45cc-925c-bc4048c3add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.237788 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff0d60-1b32-478f-853c-af8fb8e6ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.238569 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Volume b3d01422-9287-4c5f-aff6-34f806ec97c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d01422-9287-4c5f-aff6-34f806ec97c4', 'volume_size': 1} Nov 27 21:22:37.238963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-b3d01422-9287-4c5f-aff6-34f806ec97c4' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:37.239962 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:37.286900 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:37.287205 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:37.289271 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff0d60-1b32-478f-853c-af8fb8e6ab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d01422-9287-4c5f-aff6-34f806ec97c4', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.291499 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0c33a4-23af-4da6-a625-9804c5693885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:37.300530 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Volume volume-b3d01422-9287-4c5f-aff6-34f806ec97c4 (b3d01422-9287-4c5f-aff6-34f806ec97c4): created successfully Nov 27 21:22:37.302488 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0c33a4-23af-4da6-a625-9804c5693885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:37.305502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (34331bdb-c208-4d32-b6f1-41c4d04a75ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:37.312542 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f58fe2fc-db01-4f06-a7e5-64bd6543b03f tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:38.350432 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-b3d01422-9287-4c5f-aff6-34f806ec97c4-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:38.376845 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:38.415987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:38.416336 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Volume volume-b3d01422-9287-4c5f-aff6-34f806ec97c4 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:38.422066 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] deleting rbd volume volume-b3d01422-9287-4c5f-aff6-34f806ec97c4 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:38.616683 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Created reservations ['edcac92d-20c9-4f2b-8772-cb57cf9db4d1', 'b547c601-cbba-45c1-bbe7-47a9831ce755', 'bc122a4c-935c-4c90-a0c3-6fb1d8111ac2', 'fcc22379-ffe8-4be2-86c3-568112303fbf'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:38.658082 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:38.678632 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:38.700750 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:38.706189 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Deleted volume successfully. Nov 27 21:22:38.717370 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-4714e36e-507a-42aa-82dd-24eec336b19a tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-b3d01422-9287-4c5f-aff6-34f806ec97c4-delete_volume'" released by "delete_volume" :: held 0.367s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:39.700769 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:39.704003 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:39.704444 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:39.716446 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (ed550aa7-8a4d-469f-bab6-4d826b23482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:39.719943 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896f56db-e24c-4c53-9133-e1d30daf6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.727106 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:39.740197 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896f56db-e24c-4c53-9133-e1d30daf6bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1292391921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=857d4f01-f79a-46b5-8c65-95b1b8aefa76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:40Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.742844 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e39a3bf-d7bf-4d22-ac0c-56341b090ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.745109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e39a3bf-d7bf-4d22-ac0c-56341b090ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.747645 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04151ad-fcd2-4ef0-bada-23776e5c216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.749869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04151ad-fcd2-4ef0-bada-23776e5c216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857d4f01-f79a-46b5-8c65-95b1b8aefa76', 'volume_name': 'volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.752234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bd3ed7-f3b0-429b-9b35-b731d97b4ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.754342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bd3ed7-f3b0-429b-9b35-b731d97b4ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.756597 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c9a0a3-b338-4330-b318-3022db5b6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.757377 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Volume 857d4f01-f79a-46b5-8c65-95b1b8aefa76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76', 'volume_size': 1} Nov 27 21:22:39.757773 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:39.758739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:39.807593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:39.807971 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:39.809986 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c9a0a3-b338-4330-b318-3022db5b6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.812202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6c9d4-46ec-4041-a984-509e882cbcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:39.832552 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Volume volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76 (857d4f01-f79a-46b5-8c65-95b1b8aefa76): created successfully Nov 27 21:22:39.834468 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d6c9d4-46ec-4041-a984-509e882cbcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:39.837440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (ed550aa7-8a4d-469f-bab6-4d826b23482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:39.847900 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-bf1fd133-fec1-4462-bb16-f47a61d64a00 tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:39.852801 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b553048a-d410-4974-97a8-da8ea436334c tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['2fa0fddd-0bb4-4e5f-8d0f-1e109f3d7fc0', '11263549-2ed3-4d4a-a3de-a32edb120888', '9420b791-0f0f-4646-b2a8-f31f819c0787', '7adbf832-ba19-4f47-80bb-e1701a6102cb'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:39.888997 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b553048a-d410-4974-97a8-da8ea436334c tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:22:39.894291 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b553048a-d410-4974-97a8-da8ea436334c tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-94cfb469-0784-449a-b5b4-1921fb57b009-delete_snapshot'" released by "delete_snapshot" :: held 30.260s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:40.504670 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6a5374bb-f6bc-463e-b143-f068e5aa8e12 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-22360ce3-8d20-4a84-9deb-bff71da88652-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:40.506397 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6a5374bb-f6bc-463e-b143-f068e5aa8e12 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:40.877100 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-857d4f01-f79a-46b5-8c65-95b1b8aefa76-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:40.902451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:40.939821 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:40.940204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Volume volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:40.946146 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] deleting rbd volume volume-857d4f01-f79a-46b5-8c65-95b1b8aefa76 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:41.144964 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Created reservations ['79c00647-16f0-4bf4-a57a-d4b7e6a84391', '3bb1666e-0f4c-4ece-a11a-c2668a40608c', 'fa0019c0-c967-4537-8216-21995a01c9a0', '696fb833-6f99-4a46-88e5-b8739948ab67'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:41.183324 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:41.206866 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:41.228977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:41.232808 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Deleted volume successfully. Nov 27 21:22:41.244629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b7a0fd66-8910-4476-8917-b4f90d20cd14 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-857d4f01-f79a-46b5-8c65-95b1b8aefa76-delete_volume'" released by "delete_volume" :: held 0.368s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:42.220112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:42.223998 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:42.224445 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:42.236950 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (246e49c3-b142-4758-bd87-1b00c75ceff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:42.240172 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17177e84-e560-4eeb-a7aa-2c287fe1ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.246418 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:42.258393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17177e84-e560-4eeb-a7aa-2c287fe1ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1593150105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44b4cf15-5a69-4e2e-88bc-d8f7f07be642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:42Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.261030 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f119ea-9bf9-4e58-80c4-43829b90df32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.263176 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f119ea-9bf9-4e58-80c4-43829b90df32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.265603 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fae0606-cf84-4746-9c06-4909cbca0f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.267857 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fae0606-cf84-4746-9c06-4909cbca0f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b4cf15-5a69-4e2e-88bc-d8f7f07be642', 'volume_name': 'volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.270172 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f63346-e58b-4423-a1d1-372329d88bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.272312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f63346-e58b-4423-a1d1-372329d88bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.274530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0406c2f4-fb03-4ec7-a43a-47be513ca32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.275325 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Volume 44b4cf15-5a69-4e2e-88bc-d8f7f07be642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642', 'volume_size': 1} Nov 27 21:22:42.275718 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:42.276674 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:42.322762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:42.323184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:42.325233 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0406c2f4-fb03-4ec7-a43a-47be513ca32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.327432 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc548f9-8640-4eee-ac77-c0028481ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:42.335767 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Volume volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642 (44b4cf15-5a69-4e2e-88bc-d8f7f07be642): created successfully Nov 27 21:22:42.337575 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc548f9-8640-4eee-ac77-c0028481ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:42.340545 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (246e49c3-b142-4758-bd87-1b00c75ceff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:42.347885 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-870c9622-7156-42c2-9ace-9ffaf231890a tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:43.395055 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-44b4cf15-5a69-4e2e-88bc-d8f7f07be642-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:43.418706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:43.459957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:43.460396 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Volume volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:43.465557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] deleting rbd volume volume-44b4cf15-5a69-4e2e-88bc-d8f7f07be642 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:43.662109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Created reservations ['afc4e513-d5b3-4929-a063-f230c41ebfe5', '691d4d1b-6d1a-446c-b21b-fa873d6f8ecd', '51a97127-0f1d-4989-a122-38eebcca9b4c', '03bf1390-a0c0-4840-8316-eba23da19706'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:43.700515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:43.721314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:43.743450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:43.747326 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Deleted volume successfully. Nov 27 21:22:43.758553 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a8929e63-cdf5-4516-ae1e-9ede47a6a519 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-44b4cf15-5a69-4e2e-88bc-d8f7f07be642-delete_volume'" released by "delete_volume" :: held 0.364s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:44.743084 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:44.746416 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:44.746876 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:44.759109 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (7520a091-f44e-4663-84c1-1a88d59d9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:44.762654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf8bf52-377b-407f-b6b1-960d5accff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.768734 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:44.780655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf8bf52-377b-407f-b6b1-960d5accff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1282848117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3591636-a5bf-4333-b183-8f0ded2e352b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:45Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.783293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b464a48e-87b1-4ed4-a174-2fcc80208700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.785482 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b464a48e-87b1-4ed4-a174-2fcc80208700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.787929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cd979b-bfee-4d1b-b726-7566053e5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.790158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cd979b-bfee-4d1b-b726-7566053e5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3591636-a5bf-4333-b183-8f0ded2e352b', 'volume_name': 'volume-f3591636-a5bf-4333-b183-8f0ded2e352b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.792537 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7970de72-7172-4ecb-8cc1-41fb71d78b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.794674 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7970de72-7172-4ecb-8cc1-41fb71d78b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.796937 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037fd9b8-16af-400c-8d17-0cd0b32d6054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.797723 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Volume f3591636-a5bf-4333-b183-8f0ded2e352b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3591636-a5bf-4333-b183-8f0ded2e352b', 'volume_size': 1} Nov 27 21:22:44.798118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-f3591636-a5bf-4333-b183-8f0ded2e352b' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:44.799673 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:44.846043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:44.846420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:44.848471 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037fd9b8-16af-400c-8d17-0cd0b32d6054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3591636-a5bf-4333-b183-8f0ded2e352b', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.850626 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2206f98-f767-43dc-b335-ffde67073330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:44.858884 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Volume volume-f3591636-a5bf-4333-b183-8f0ded2e352b (f3591636-a5bf-4333-b183-8f0ded2e352b): created successfully Nov 27 21:22:44.860704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2206f98-f767-43dc-b335-ffde67073330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:44.864348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (7520a091-f44e-4663-84c1-1a88d59d9e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:44.871276 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-972cd242-5ad0-40b5-97d4-e949d1e31518 tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:45.918122 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-f3591636-a5bf-4333-b183-8f0ded2e352b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:45.943172 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:45.979742 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:45.980098 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Volume volume-f3591636-a5bf-4333-b183-8f0ded2e352b is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:45.984834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] deleting rbd volume volume-f3591636-a5bf-4333-b183-8f0ded2e352b {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:46.174061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Created reservations ['07b532a4-3279-43b9-99bb-3db3b709fff5', 'b05fdcd0-3d4e-4fe3-a121-7e3101648792', '4f00c546-1b0e-4ab5-852f-4252a98937ac', 'ba16f4f2-0178-4ffe-9178-e087be1ee227'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:46.213024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:46.234472 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:46.259430 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:46.263957 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Deleted volume successfully. Nov 27 21:22:46.276800 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-28bb24a3-aef1-4794-8f19-79024ec4c9a1 tempest-VolumesActionsTest-1903701307 None] Lock "b'cinder-f3591636-a5bf-4333-b183-8f0ded2e352b-delete_volume'" released by "delete_volume" :: held 0.359s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:47.256081 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:47.259843 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:47.259981 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:47.272400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (2ec8eb10-eeda-482f-a3b3-8c1b015d76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:47.275518 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799a034-9bcc-48fa-85e2-eed983ccfecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.281475 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:47.295958 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799a034-9bcc-48fa-85e2-eed983ccfecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162059272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a63ba37-d7c5-40a7-9d93-d1a06d8db904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686a8233f0e94b2bac7e4eb02ac5a4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:47Z,use_quota=True,user_id='4c026d87d35444e8a8a722c1d3cde5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.298589 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b8e237-012b-4594-8a03-0c5233c90c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.300739 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b8e237-012b-4594-8a03-0c5233c90c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.303111 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a3029e-cda7-4870-9daa-a9749df0a7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.305342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a3029e-cda7-4870-9daa-a9749df0a7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a63ba37-d7c5-40a7-9d93-d1a06d8db904', 'volume_name': 'volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.307652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d38f70-2539-4782-bbdd-24e216276911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.309734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d38f70-2539-4782-bbdd-24e216276911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.311941 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7a91f0-4424-4f1a-8e40-02d65ca885c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.312713 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Volume 6a63ba37-d7c5-40a7-9d93-d1a06d8db904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904', 'volume_size': 1} Nov 27 21:22:47.313097 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] creating volume 'volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:47.314579 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:47.363055 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:47.363473 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:47.365449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7a91f0-4424-4f1a-8e40-02d65ca885c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.367673 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ce358-f558-492f-ac82-78fc7508b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:47.376158 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Volume volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904 (6a63ba37-d7c5-40a7-9d93-d1a06d8db904): created successfully Nov 27 21:22:47.378457 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ce358-f558-492f-ac82-78fc7508b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:47.381384 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Flow 'volume_create_manager' (2ec8eb10-eeda-482f-a3b3-8c1b015d76d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:47.388466 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-daa9c39b-a380-48ad-a235-f48d0426fa59 tempest-VolumesActionsTest-1294016791 None] Created volume successfully. Nov 27 21:22:48.768013 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-6a63ba37-d7c5-40a7-9d93-d1a06d8db904-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:48.797174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:48.831967 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:48.832320 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Volume volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:48.837750 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] deleting rbd volume volume-6a63ba37-d7c5-40a7-9d93-d1a06d8db904 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:49.021134 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Created reservations ['c059fa34-9b2d-47d6-bf4a-a7fae0bfc8e1', '8211a3af-6374-4fe0-8e84-03d75613738e', '140d746f-59f5-46df-8167-551673ff01e4', 'ab267ddb-25a2-45b3-ae56-4a748c8ea49c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:49.060813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:49.081227 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:49.103103 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:49.107028 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Deleted volume successfully. Nov 27 21:22:49.119540 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-719e54de-5759-400b-a883-20783ca52f69 tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-6a63ba37-d7c5-40a7-9d93-d1a06d8db904-delete_volume'" released by "delete_volume" :: held 0.352s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:49.960599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:22:49.990460 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:50.025590 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:22:50.026017 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Volume volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:22:50.031630 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] deleting rbd volume volume-fa23a4f1-c79b-4d46-b067-c0fb6d614060 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:22:50.250920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Created reservations ['99b21f3a-69ef-45a3-b1bd-84e814fecbd3', '82a55191-8fc1-4181-a885-41d3228a6d84', '15262dbd-903c-4d50-9504-a080af6afa71', 'c8ec5e04-c228-468c-8b41-1ca75662b811'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:22:50.293269 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:50.318260 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:50.344688 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:22:50.349267 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Deleted volume successfully. Nov 27 21:22:50.361482 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-29b9941f-a48b-47ad-840c-c70c999a487d tempest-VolumesActionsTest-1294016791 None] Lock "b'cinder-fa23a4f1-c79b-4d46-b067-c0fb6d614060-delete_volume'" released by "delete_volume" :: held 0.401s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:22:55.318985 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:22:55.324453 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:22:55.324899 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:22:55.336809 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (098f2b0e-e791-4c1c-b717-5fae62a3c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:55.339986 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e66e7b-3655-458b-8d52-5dc82c618fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.346603 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:22:55.358704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e66e7b-3655-458b-8d52-5dc82c618fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-361135252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdd54218-1833-48c7-b2c5-a71771d4a096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83b027153ea42e1b193393f015947f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:22:55Z,use_quota=True,user_id='5aa295a582b041a1a535958cbeb50e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.362145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d8c9d9-b664-4efe-8bc1-d91151a81c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.364300 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d8c9d9-b664-4efe-8bc1-d91151a81c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.366674 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18852df4-79b0-4632-8276-d5e1b94c25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.368920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18852df4-79b0-4632-8276-d5e1b94c25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd54218-1833-48c7-b2c5-a71771d4a096', 'volume_name': 'volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.371207 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f80b28-8156-4758-87a0-5ea2b02e885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.373331 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f80b28-8156-4758-87a0-5ea2b02e885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.375552 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89873f1-6bd0-4335-97f7-608cedff044f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.376330 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Volume fdd54218-1833-48c7-b2c5-a71771d4a096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'volume_size': 1} Nov 27 21:22:55.377899 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] creating volume 'volume-fdd54218-1833-48c7-b2c5-a71771d4a096' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:22:55.378878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:55.449791 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:22:55.450177 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:22:55.452356 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89873f1-6bd0-4335-97f7-608cedff044f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.454571 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81959144-1d0d-4971-9d0d-562c97ba6e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:22:55.463065 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Volume volume-fdd54218-1833-48c7-b2c5-a71771d4a096 (fdd54218-1833-48c7-b2c5-a71771d4a096): created successfully Nov 27 21:22:55.465074 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81959144-1d0d-4971-9d0d-562c97ba6e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:22:55.468073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (098f2b0e-e791-4c1c-b717-5fae62a3c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:22:55.476347 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-9a83e14c-a948-4e38-8acb-bf658dd54358 tempest-VolumesBackupsTest-1517995977 None] Created volume successfully. Nov 27 21:22:57.921810 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:22:57.922556 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:57.959809 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:22:58.016346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:09.127558 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-6852a938-3fd7-4478-a155-dd36f379fae1 req-26692fdc-b260-4be5-8c77-b877a9571549 tempest-VolumesBackupsTest-1517995977 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:23:09.758792 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-6852a938-3fd7-4478-a155-dd36f379fae1 req-26692fdc-b260-4be5-8c77-b877a9571549 tempest-VolumesBackupsTest-1517995977 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:23:09.759697 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-6852a938-3fd7-4478-a155-dd36f379fae1 req-26692fdc-b260-4be5-8c77-b877a9571549 tempest-VolumesBackupsTest-1517995977 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'fdd54218-1833-48c7-b2c5-a71771d4a096', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:23:09.781931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-6852a938-3fd7-4478-a155-dd36f379fae1 req-26692fdc-b260-4be5-8c77-b877a9571549 tempest-VolumesBackupsTest-1517995977 None] Connection info returned from driver {'name': 'volumes/volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fdd54218-1833-48c7-b2c5-a71771d4a096', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dee47db0-0567-4580-8749-0c6577072713'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:23:09.826689 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-6852a938-3fd7-4478-a155-dd36f379fae1 req-26692fdc-b260-4be5-8c77-b877a9571549 tempest-VolumesBackupsTest-1517995977 None] attachment_update completed successfully. Nov 27 21:23:10.649772 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-6a5374bb-f6bc-463e-b143-f068e5aa8e12 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['e44ba7c6-d8e4-4eb2-87e7-ccce0075c590', '83ce29f2-d841-4999-85fa-efc626b479e1', 'c8ba596a-c840-4053-be8c-ff22471c8b61', '58354e67-233b-4a58-a7f5-594a046f62ee'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:10.684873 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6a5374bb-f6bc-463e-b143-f068e5aa8e12 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:23:10.690202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6a5374bb-f6bc-463e-b143-f068e5aa8e12 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-22360ce3-8d20-4a84-9deb-bff71da88652-delete_snapshot'" released by "delete_snapshot" :: held 30.186s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:12.171647 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-4979f803-eb7c-43d9-852a-943c457dc080 req-cef02ce3-28d6-4d6e-97d1-87e43e0fc61b tempest-VolumesSnapshotTestJSON-481511107 None] Terminate volume connection completed successfully. Nov 27 21:23:12.172232 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-4979f803-eb7c-43d9-852a-943c457dc080 req-cef02ce3-28d6-4d6e-97d1-87e43e0fc61b tempest-VolumesSnapshotTestJSON-481511107 None] Deleting attachment 21dcb76c-d937-4804-829f-c6d48467007e. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:23:12.461302 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:23:13.104391 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:23:13.105214 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fdd54218-1833-48c7-b2c5-a71771d4a096', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'fdd54218-1833-48c7-b2c5-a71771d4a096', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:23:13.122463 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] Initialize volume connection completed successfully. Nov 27 21:23:14.846075 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] Terminate volume connection completed successfully. Nov 27 21:23:14.867797 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8fbeede7-a9be-49c3-8f89-7699295c7800 tempest-VolumesBackupsTest-1517995977 None] Remove volume export completed successfully. Nov 27 21:23:16.443158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:16.456269 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:16.456923 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:16.479825 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (8988df5e-1db8-48d4-82c7-a5ad51600ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:16.483624 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261c77b1-6aac-46e7-bf6b-7e963ebc217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.490871 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:16.503328 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261c77b1-6aac-46e7-bf6b-7e963ebc217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-237228874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5029c29-e519-4ce7-8818-80af51415492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:16Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.506004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469b8d83-0e4f-4d42-b4eb-52f486e4282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.508171 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469b8d83-0e4f-4d42-b4eb-52f486e4282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.510610 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b800251b-3f0a-4cd5-a33b-8af2d5eb6a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.513169 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b800251b-3f0a-4cd5-a33b-8af2d5eb6a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5029c29-e519-4ce7-8818-80af51415492', 'volume_name': 'volume-f5029c29-e519-4ce7-8818-80af51415492', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.515627 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e1008d-87a7-4b1d-9163-63817243f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.518570 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e1008d-87a7-4b1d-9163-63817243f066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.520962 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d55ae39-4aa3-4359-82cf-616f46fcaead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.521820 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Volume f5029c29-e519-4ce7-8818-80af51415492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5029c29-e519-4ce7-8818-80af51415492', 'volume_size': 1} Nov 27 21:23:16.522316 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] creating volume 'volume-f5029c29-e519-4ce7-8818-80af51415492' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:23:16.523412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:16.591623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:16.592296 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:16.594486 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d55ae39-4aa3-4359-82cf-616f46fcaead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5029c29-e519-4ce7-8818-80af51415492', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.596872 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dc33bd-48ea-4288-bf1b-e190e1f2b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:16.605348 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-f5029c29-e519-4ce7-8818-80af51415492 (f5029c29-e519-4ce7-8818-80af51415492): created successfully Nov 27 21:23:16.607377 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dc33bd-48ea-4288-bf1b-e190e1f2b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:16.610508 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (8988df5e-1db8-48d4-82c7-a5ad51600ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:16.618479 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-91ebcda4-95d3-4d13-b8f8-325c0bc8582b tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:23:17.626174 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-32e859e8-986b-48d2-848f-68e98b7bd6ba tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:18.494929 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 req-73a99140-774e-43a7-b243-54caf4b98e83 tempest-VolumesBackupsTest-1517995977 None] Terminate volume connection completed successfully. Nov 27 21:23:18.495394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 req-73a99140-774e-43a7-b243-54caf4b98e83 tempest-VolumesBackupsTest-1517995977 None] Deleting attachment dee47db0-0567-4580-8749-0c6577072713. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:23:18.532493 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-32e859e8-986b-48d2-848f-68e98b7bd6ba tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:23:18.988946 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:18.993094 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:18.993537 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:19.016465 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (1eb3f55f-43e8-49f9-afa8-0cd659bb3054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:19.020279 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba225424-8420-4c2d-849d-63581dea62c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.026479 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:19.038972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba225424-8420-4c2d-849d-63581dea62c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-569304628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=406f9670-99ae-4e59-a506-6c5db74bc2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fcd95018-06bb-45c8-b270-c797f0697d51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:19Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.041581 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f625cbd-a981-42cb-bf03-736f4d2e1aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.043745 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f625cbd-a981-42cb-bf03-736f4d2e1aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.046168 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89334fe7-88dd-4f1d-8801-c9c6ba7e02fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.048447 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89334fe7-88dd-4f1d-8801-c9c6ba7e02fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '406f9670-99ae-4e59-a506-6c5db74bc2d3', 'volume_name': 'volume-406f9670-99ae-4e59-a506-6c5db74bc2d3', 'volume_size': 2, 'snapshot_id': 'fcd95018-06bb-45c8-b270-c797f0697d51'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.050756 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df50234-1b7a-4c44-8b6e-9fe0330c2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.052947 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df50234-1b7a-4c44-8b6e-9fe0330c2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.055142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d53fd10-99d9-459a-abff-7d0bd9d1d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.055957 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Volume 406f9670-99ae-4e59-a506-6c5db74bc2d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-406f9670-99ae-4e59-a506-6c5db74bc2d3', 'volume_size': 2, 'snapshot_id': 'fcd95018-06bb-45c8-b270-c797f0697d51'} Nov 27 21:23:19.074005 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] cloning volumes/volume-f5029c29-e519-4ce7-8818-80af51415492@snapshot-fcd95018-06bb-45c8-b270-c797f0697d51 to volume-406f9670-99ae-4e59-a506-6c5db74bc2d3 {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:23:19.074913 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:19.118339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:19.229708 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:19.230087 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:19.233932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:19.330473 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d53fd10-99d9-459a-abff-7d0bd9d1d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406f9670-99ae-4e59-a506-6c5db74bc2d3', 'volume_size': 2, 'snapshot_id': 'fcd95018-06bb-45c8-b270-c797f0697d51'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.332725 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6b462-f0fa-4bd9-a752-5872fc84373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:19.341029 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-406f9670-99ae-4e59-a506-6c5db74bc2d3 (406f9670-99ae-4e59-a506-6c5db74bc2d3): created successfully Nov 27 21:23:19.342846 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6b462-f0fa-4bd9-a752-5872fc84373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:19.345819 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (1eb3f55f-43e8-49f9-afa8-0cd659bb3054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:19.357488 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-da532ec2-5f11-4d4c-ad90-eb6ef98fade5 tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:23:20.082529 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-406f9670-99ae-4e59-a506-6c5db74bc2d3-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:20.136186 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:20.188616 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:20.195636 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-406f9670-99ae-4e59-a506-6c5db74bc2d3 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:20.420544 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['02d51db8-6925-41ec-add0-670db9c854e7', 'ac2b4c0e-cc97-4456-8bf3-00f5669cc3d5', '8dd332d2-1f18-499e-8f19-752bd5d1e880', '71519cd8-e086-49a6-8457-b5195339f8ac'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:20.468256 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:20.506348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:20.533930 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:20.539195 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:20.552148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-2b413041-ec7b-440b-9388-70b92d77fd98 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-406f9670-99ae-4e59-a506-6c5db74bc2d3-delete_volume'" released by "delete_volume" :: held 0.470s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:21.545052 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:21.548639 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:21.549095 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:21.561238 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (ccc76086-90df-411c-9ca9-c2237d45ff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:21.564912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc3b512-5f6a-4141-bea1-71ed17d09807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.571237 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:21.583946 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc3b512-5f6a-4141-bea1-71ed17d09807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1250932222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92747b06-8498-4182-9cde-bb8609003e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:22Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.586509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bd245e-0dad-4f2b-8788-fe67d39cb433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.588667 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bd245e-0dad-4f2b-8788-fe67d39cb433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.591057 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46335caa-8af5-4bc4-b2a8-fc42b9c6249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.593332 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46335caa-8af5-4bc4-b2a8-fc42b9c6249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92747b06-8498-4182-9cde-bb8609003e89', 'volume_name': 'volume-92747b06-8498-4182-9cde-bb8609003e89', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.596346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1902540b-4c08-49f5-8176-9f31dca82652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.598455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1902540b-4c08-49f5-8176-9f31dca82652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.600685 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c70a6c3-0840-4afd-a6b3-9bb3cf145df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.601533 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Volume 92747b06-8498-4182-9cde-bb8609003e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92747b06-8498-4182-9cde-bb8609003e89', 'volume_size': 1} Nov 27 21:23:21.601925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] creating volume 'volume-92747b06-8498-4182-9cde-bb8609003e89' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:23:21.602891 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:21.652014 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:21.652417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:21.654407 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c70a6c3-0840-4afd-a6b3-9bb3cf145df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92747b06-8498-4182-9cde-bb8609003e89', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.656651 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acc502a-0978-43fd-8b6c-a8e2dc60fcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:21.666049 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-92747b06-8498-4182-9cde-bb8609003e89 (92747b06-8498-4182-9cde-bb8609003e89): created successfully Nov 27 21:23:21.667933 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acc502a-0978-43fd-8b6c-a8e2dc60fcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:21.670842 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (ccc76086-90df-411c-9ca9-c2237d45ff8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:21.678064 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-14e39524-603f-404f-b2b4-a2edc6d0461b tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:23:22.604288 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-fdd54218-1833-48c7-b2c5-a71771d4a096-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:22.652222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:23.582728 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Volume volume-fdd54218-1833-48c7-b2c5-a71771d4a096 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:23.594453 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] deleting rbd volume volume-fdd54218-1833-48c7-b2c5-a71771d4a096 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:23.622201 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ba5f3325-ea1c-4f5c-91c6-f82fe120d1d8 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:23.815449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Created reservations ['b1369d09-6ff7-45f4-ac3d-89a7fb9199e7', '310849c8-f38b-4d35-b15c-67ad81248816', 'de8d354a-5afc-45be-bc8b-64ab4d329b33', 'e1a7cc11-d1c1-40d8-a390-22f578862624'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:23.865553 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:23.887952 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:23.910415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:23.914639 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Deleted volume successfully. Nov 27 21:23:23.926121 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-e8b10820-a86d-4cf1-8607-99b961effce0 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-fdd54218-1833-48c7-b2c5-a71771d4a096-delete_volume'" released by "delete_volume" :: held 1.322s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:24.647456 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ba5f3325-ea1c-4f5c-91c6-f82fe120d1d8 tempest-VolumesSnapshotTestJSON-481511107 None] Create snapshot completed successfully Nov 27 21:23:25.073550 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:25.077847 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:25.078308 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:25.103073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (2b1b5a89-1cf4-4469-b93c-727221f70869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:25.106430 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3081b79-faba-4716-94af-0a8f72e8515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.116311 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:25.128823 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3081b79-faba-4716-94af-0a8f72e8515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2060873887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab8e0ccd-528e-483e-a80d-37a3ce6a319d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05afa0d2a44144078e3fa7d820a95510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9201481-6a38-4f3c-b6ba-1e7c3841bbea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:25Z,use_quota=True,user_id='6e49ff29764540ae95d8b9d0f9d4fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.131434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73329fe1-3087-4cd6-97ee-17ee91a98e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.142056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73329fe1-3087-4cd6-97ee-17ee91a98e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.144323 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a933c47e-182f-429c-b9e2-528f540f0d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.146557 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a933c47e-182f-429c-b9e2-528f540f0d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab8e0ccd-528e-483e-a80d-37a3ce6a319d', 'volume_name': 'volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d', 'volume_size': 1, 'snapshot_id': 'c9201481-6a38-4f3c-b6ba-1e7c3841bbea'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.149037 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae9331b-9321-4b3d-8307-442068d4e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.151149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae9331b-9321-4b3d-8307-442068d4e079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.153506 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da94f28-f80d-4539-a76c-4fb539a36324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.154326 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Volume ab8e0ccd-528e-483e-a80d-37a3ce6a319d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d', 'volume_size': 1, 'snapshot_id': 'c9201481-6a38-4f3c-b6ba-1e7c3841bbea'} Nov 27 21:23:25.179929 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] cloning volumes/volume-92747b06-8498-4182-9cde-bb8609003e89@snapshot-c9201481-6a38-4f3c-b6ba-1e7c3841bbea to volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:23:25.180834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:25.213943 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:25.246306 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:25.249814 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:25.250253 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:25.263546 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (b5aaf7b6-5236-4d18-ada2-0d0926d05e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:25.267516 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd5a13-c598-4252-adff-3ca4f264d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.274101 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:25.287657 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd5a13-c598-4252-adff-3ca4f264d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-77497655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=70893a5c-b091-4700-bd50-978ce73dc56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83b027153ea42e1b193393f015947f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:25Z,use_quota=True,user_id='5aa295a582b041a1a535958cbeb50e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.290362 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b891f98-4bc9-4133-900b-b991cd531e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.292804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b891f98-4bc9-4133-900b-b991cd531e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.295519 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d89b10a-276f-42d0-810c-7adf9e5af95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.313278 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:25.313652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:25.339421 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da94f28-f80d-4539-a76c-4fb539a36324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d', 'volume_size': 1, 'snapshot_id': 'c9201481-6a38-4f3c-b6ba-1e7c3841bbea'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.341671 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5044578-46b5-40b7-a4df-34b8f88b322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.351721 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d (ab8e0ccd-528e-483e-a80d-37a3ce6a319d): created successfully Nov 27 21:23:25.353940 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5044578-46b5-40b7-a4df-34b8f88b322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.357374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Flow 'volume_create_manager' (2b1b5a89-1cf4-4469-b93c-727221f70869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:25.378016 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-78e9c8c8-c315-4c6b-9f32-b8c6ee1acac6 tempest-VolumesSnapshotTestJSON-481511107 None] Created volume successfully. Nov 27 21:23:25.388173 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d89b10a-276f-42d0-810c-7adf9e5af95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70893a5c-b091-4700-bd50-978ce73dc56b', 'volume_name': 'volume-70893a5c-b091-4700-bd50-978ce73dc56b', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.390691 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682a1cab-eed7-489d-9b6f-319f854188a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.393360 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682a1cab-eed7-489d-9b6f-319f854188a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:25.395604 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92549759-2a04-493d-94e7-0cb8bef1e94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:25.396427 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Volume 70893a5c-b091-4700-bd50-978ce73dc56b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70893a5c-b091-4700-bd50-978ce73dc56b', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:23:25.396997 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Cloning 70893a5c-b091-4700-bd50-978ce73dc56b from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:23:25.405629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:25.414534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 23, 25, 409872)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:23:25.414970 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:23:25.415411 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:23:25.419407 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:25.420266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:23:25.425314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 23, 25, 423184)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:23:25.425734 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:23:25.426133 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:23:25.437662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:25.487202 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] creating snapshot='volume-70893a5c-b091-4700-bd50-978ce73dc56b.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:23:26.519698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-70893a5c-b091-4700-bd50-978ce73dc56b.clone_snap' to 'volume-70893a5c-b091-4700-bd50-978ce73dc56b' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:23:26.532138 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-ab8e0ccd-528e-483e-a80d-37a3ce6a319d-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:26.563311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:26.615484 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:26.621134 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-ab8e0ccd-528e-483e-a80d-37a3ce6a319d {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:26.661005 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:26.662747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:26.663186 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:26.685687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:23:26.686313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Marking volume 70893a5c-b091-4700-bd50-978ce73dc56b as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:23:26.694678 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 70893a5c-b091-4700-bd50-978ce73dc56b. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:23:26.695237 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Creating volume glance metadata for volume 70893a5c-b091-4700-bd50-978ce73dc56b backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:23:26.746676 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92549759-2a04-493d-94e7-0cb8bef1e94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70893a5c-b091-4700-bd50-978ce73dc56b', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:26.748715 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd62a7b-c280-4103-ad74-a9bc413384c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:26.757280 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Volume volume-70893a5c-b091-4700-bd50-978ce73dc56b (70893a5c-b091-4700-bd50-978ce73dc56b): created successfully Nov 27 21:23:26.759184 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd62a7b-c280-4103-ad74-a9bc413384c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:26.762550 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (b5aaf7b6-5236-4d18-ada2-0d0926d05e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:26.770558 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-719604b1-f1c8-47a2-8076-7fd5b76c9efd tempest-VolumesBackupsTest-1517995977 None] Created volume successfully. Nov 27 21:23:26.836694 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['dcb13751-3c6c-4aed-9905-c66dbda7b42a', 'bc376601-89ca-4292-9b91-8ae5c7f410dd', '2b59d9b3-a96c-41d7-a056-fdac0900f140', '9889956a-6fd9-4333-a7c4-df8fd85e38e9'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:26.874246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:26.896397 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:26.919789 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:26.925011 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:26.939056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dcd39052-d732-4281-9823-3578ce251494 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-ab8e0ccd-528e-483e-a80d-37a3ce6a319d-delete_volume'" released by "delete_volume" :: held 0.407s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:27.315723 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6c68bcf9-f9b4-4c1e-9ff1-b8aee81e4490 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-c9201481-6a38-4f3c-b6ba-1e7c3841bbea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:27.317323 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6c68bcf9-f9b4-4c1e-9ff1-b8aee81e4490 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:27.544200 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:23:27.683105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-6c68bcf9-f9b4-4c1e-9ff1-b8aee81e4490 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['243f9150-1ff5-4d16-a289-b4bedc674f52', 'd8979bfa-0495-4116-a3a2-5012c66d46b7', '4367f13e-cb21-4fbb-9e18-61060bf2a48b', '6cf63478-6ce5-44df-a317-157f6c545c2e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:27.725357 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6c68bcf9-f9b4-4c1e-9ff1-b8aee81e4490 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:23:27.731131 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6c68bcf9-f9b4-4c1e-9ff1-b8aee81e4490 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-c9201481-6a38-4f3c-b6ba-1e7c3841bbea-delete_snapshot'" released by "delete_snapshot" :: held 0.416s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:28.180359 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:23:28.181129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-70893a5c-b091-4700-bd50-978ce73dc56b', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '70893a5c-b091-4700-bd50-978ce73dc56b', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:23:28.193406 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] Initialize volume connection completed successfully. Nov 27 21:23:28.408858 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-92747b06-8498-4182-9cde-bb8609003e89-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:28.449140 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:28.488244 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:28.488696 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-92747b06-8498-4182-9cde-bb8609003e89 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:28.493972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-92747b06-8498-4182-9cde-bb8609003e89 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:28.723558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['dc2aae0e-a727-41d0-b256-d77683c4407b', '065a6529-c8b1-4d60-bfca-cedfe83cff46', 'eaad3b34-52d1-484e-8e1d-55bcf73a5686', '9a841eef-f6cc-4e4e-b2b0-e9db2a1bc34b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:28.784659 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:28.805953 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:28.835364 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:28.846555 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:28.860097 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a909a68a-6ec1-4fd1-8fa7-56452bbb99d8 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-92747b06-8498-4182-9cde-bb8609003e89-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:29.560693 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5a3f1a39-10fe-495d-b97f-2b146a2684ad tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-fcd95018-06bb-45c8-b270-c797f0697d51-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:29.562230 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5a3f1a39-10fe-495d-b97f-2b146a2684ad tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:30.777269 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-5a3f1a39-10fe-495d-b97f-2b146a2684ad tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['144c77bc-2065-4940-b5e2-bb67deca68fd', '0e3eb338-6955-4e9c-a372-e8b4bfa15178', '7d899a38-aef4-4d9d-9933-a1f80574adfe', '2bafafb7-2eaf-476c-a558-ca2a635703db'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:30.825329 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5a3f1a39-10fe-495d-b97f-2b146a2684ad tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:23:30.831158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5a3f1a39-10fe-495d-b97f-2b146a2684ad tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-fcd95018-06bb-45c8-b270-c797f0697d51-delete_snapshot'" released by "delete_snapshot" :: held 1.271s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:31.711588 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-f5029c29-e519-4ce7-8818-80af51415492-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:31.752398 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:32.077905 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:32.078630 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-f5029c29-e519-4ce7-8818-80af51415492 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:32.094570 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-f5029c29-e519-4ce7-8818-80af51415492 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:33.463189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['a7170575-dbd6-4cbb-b831-1b542b705c29', 'd49096b4-cb9b-4713-9ee0-2babdcaa5611', '91f06ddb-7c21-40d8-bb6c-a21db5a97c71', '3eb21c98-7297-4fba-917f-4426835a3aa5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:33.535620 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:33.580851 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:33.619866 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:33.630856 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:33.647607 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-f6059bb5-6a5e-4e0a-be9f-cd2eed9a2b08 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-f5029c29-e519-4ce7-8818-80af51415492-delete_volume'" released by "delete_volume" :: held 1.936s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:34.003615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-555cdd24-e7af-4c5f-85e7-abcbaa558327-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:34.036035 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:34.104623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:34.111361 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-555cdd24-e7af-4c5f-85e7-abcbaa558327 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:34.268440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:23:34.298782 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] deleting parent snapshot volume-555cdd24-e7af-4c5f-85e7-abcbaa558327.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:23:34.633412 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['03bfddec-cf5d-4704-9351-cfb0476e7630', '90c946dd-7e36-4410-928a-4d62eef47414', '8b67fc71-6e42-47bd-ae72-7c31b8f86ccf', '77823cd1-8c3f-4af3-9d05-6669d8b7e86e'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:34.676940 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:34.701342 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:34.728704 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:34.738849 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:34.747949 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] Terminate volume connection completed successfully. Nov 27 21:23:34.764617 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-3d251613-9d0a-492b-9d5c-b6c11bc8b940 tempest-VolumesBackupsTest-1517995977 None] Remove volume export completed successfully. Nov 27 21:23:34.772724 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-22299361-20cb-4531-bfe9-9376ca24d265 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-555cdd24-e7af-4c5f-85e7-abcbaa558327-delete_volume'" released by "delete_volume" :: held 0.769s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:35.127905 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-40333c08-e85b-4de9-b7f2-0d4252e92ea3 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-8ba87091-9c28-487a-a2a8-727c8531218a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:35.129498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-40333c08-e85b-4de9-b7f2-0d4252e92ea3 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:35.575592 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-40333c08-e85b-4de9-b7f2-0d4252e92ea3 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['6bad32d4-b1b9-4319-bf8b-0c0b03b72f7a', '5ae33a06-dbfa-411a-85c9-637ca3050de3', 'bab01048-3bca-48b0-a6bf-e544bdab1b4b', 'ff4d4039-9ef2-4ef6-94f4-189cdc52b85c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:35.607678 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-40333c08-e85b-4de9-b7f2-0d4252e92ea3 tempest-VolumesSnapshotTestJSON-481511107 None] Delete snapshot completed successfully. Nov 27 21:23:35.612999 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-40333c08-e85b-4de9-b7f2-0d4252e92ea3 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-8ba87091-9c28-487a-a2a8-727c8531218a-delete_snapshot'" released by "delete_snapshot" :: held 0.485s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:35.982231 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:35.986406 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:35.986901 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:36.000008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (1b448cb0-7a77-4802-9e11-8c50d87c2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:36.004394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf64054-941f-4a24-8696-17eb265a14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.010853 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:36.023648 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf64054-941f-4a24-8696-17eb265a14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:36Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_0d4c34ac-d139-49d9-9e6b-b4258ea64006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96161016-d59e-4579-b4c2-6215c2dc63be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83b027153ea42e1b193393f015947f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:36Z,use_quota=True,user_id='5aa295a582b041a1a535958cbeb50e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.026232 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e4c7d0-36b7-4d87-a4ea-21e4b5d83bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.028427 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e4c7d0-36b7-4d87-a4ea-21e4b5d83bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.030890 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd9e690-c5d6-40ce-a61c-69a9d8f36bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.033467 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd9e690-c5d6-40ce-a61c-69a9d8f36bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96161016-d59e-4579-b4c2-6215c2dc63be', 'volume_name': 'volume-96161016-d59e-4579-b4c2-6215c2dc63be', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.037179 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa6fd4d-fc93-4607-a120-883b6f6dfe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.040235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa6fd4d-fc93-4607-a120-883b6f6dfe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.042481 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46054032-f804-41f1-a5a1-9d349edb087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.043296 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Volume 96161016-d59e-4579-b4c2-6215c2dc63be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96161016-d59e-4579-b4c2-6215c2dc63be', 'volume_size': 1} Nov 27 21:23:36.043706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] creating volume 'volume-96161016-d59e-4579-b4c2-6215c2dc63be' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:23:36.044744 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:36.093493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:36.093872 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:36.095925 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46054032-f804-41f1-a5a1-9d349edb087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96161016-d59e-4579-b4c2-6215c2dc63be', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.098126 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85bfc57-9207-4c4d-9ca7-6fdebc613de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:36.106641 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Volume volume-96161016-d59e-4579-b4c2-6215c2dc63be (96161016-d59e-4579-b4c2-6215c2dc63be): created successfully Nov 27 21:23:36.108706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85bfc57-9207-4c4d-9ca7-6fdebc613de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:36.112008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Flow 'volume_create_manager' (1b448cb0-7a77-4802-9e11-8c50d87c2153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:36.119348 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Created volume successfully. Nov 27 21:23:36.216161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:36.245832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:36.287780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:36.288237 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Volume volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:36.294266 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] deleting rbd volume volume-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:36.495532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Created reservations ['ef00358e-d0b0-4c39-adc6-0ab7bf9817d9', 'ff43abbc-8161-4af3-83bc-ee401422197a', 'd6dbee91-d3f9-4d95-8a48-4104e7ad4490', '7b2f6b40-2e6f-442c-8560-830cab5b6a23'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:36.534255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:36.561192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:36.583666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:36.587855 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Deleted volume successfully. Nov 27 21:23:36.599197 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-110231ce-15d0-469a-977d-d80d0f5e5bf0 tempest-VolumesSnapshotTestJSON-481511107 None] Lock "b'cinder-f4f886f9-5e7d-4b5a-bdf9-24c0605166d5-delete_volume'" released by "delete_volume" :: held 0.383s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:37.045563 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:23:37.794410 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:23:37.795235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-96161016-d59e-4579-b4c2-6215c2dc63be', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '96161016-d59e-4579-b4c2-6215c2dc63be', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:23:37.809718 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Initialize volume connection completed successfully. Nov 27 21:23:39.880636 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:39.885381 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:39.885925 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:39.901259 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Flow 'volume_create_manager' (3f46dcd7-2c4f-44c3-910c-8fdf2d2cca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:39.905441 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abc305b-d49a-44b0-b4a4-c78871e3b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:39.916591 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:39.936313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abc305b-d49a-44b0-b4a4-c78871e3b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-782305706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81380aaf-faa0-415e-a532-7be1a8ec3780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0472ce0ce9426facb631be6459a422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:40Z,use_quota=True,user_id='1d735726954247d4831492fa0ff93f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:39.940976 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc246600-fe40-4e76-a666-46cc8f431159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:39.941710 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc246600-fe40-4e76-a666-46cc8f431159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:39.944691 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee46c05-fecb-47ad-9094-948a53bc9b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:39.947956 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee46c05-fecb-47ad-9094-948a53bc9b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81380aaf-faa0-415e-a532-7be1a8ec3780', 'volume_name': 'volume-81380aaf-faa0-415e-a532-7be1a8ec3780', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:39.951024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9387193c-3de4-4474-84cd-decc792c47f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:39.953867 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9387193c-3de4-4474-84cd-decc792c47f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:39.956485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0565eef-18ae-4a35-ad66-2684564d72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:39.957799 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Volume 81380aaf-faa0-415e-a532-7be1a8ec3780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81380aaf-faa0-415e-a532-7be1a8ec3780', 'volume_size': 1} Nov 27 21:23:39.958408 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] creating volume 'volume-81380aaf-faa0-415e-a532-7be1a8ec3780' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:23:39.959851 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:40.115163 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:40.115594 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:40.118117 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0565eef-18ae-4a35-ad66-2684564d72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81380aaf-faa0-415e-a532-7be1a8ec3780', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:40.120525 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1629850-7058-46af-bc4e-11933e25f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:40.131181 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Volume volume-81380aaf-faa0-415e-a532-7be1a8ec3780 (81380aaf-faa0-415e-a532-7be1a8ec3780): created successfully Nov 27 21:23:40.133580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1629850-7058-46af-bc4e-11933e25f55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:40.137006 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Flow 'volume_create_manager' (3f46dcd7-2c4f-44c3-910c-8fdf2d2cca43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:40.149752 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-420a9e35-77e0-415c-be53-b886ca0792bf tempest-VolumesSnapshotListTestJSON-220301814 None] Created volume successfully. Nov 27 21:23:41.171757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0a42367b-8534-4d51-8ca8-d2c90af864e2 tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:41.753381 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0a42367b-8534-4d51-8ca8-d2c90af864e2 tempest-VolumesSnapshotListTestJSON-220301814 None] Create snapshot completed successfully Nov 27 21:23:41.975016 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Terminate volume connection completed successfully. Nov 27 21:23:41.990706 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c4dc1d7a-c788-4855-9db4-450c6995fe2b tempest-VolumesBackupsTest-1517995977 None] Remove volume export completed successfully. Nov 27 21:23:42.278204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-96161016-d59e-4579-b4c2-6215c2dc63be-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:42.327282 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:42.705394 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Volume volume-96161016-d59e-4579-b4c2-6215c2dc63be is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:42.722056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] deleting rbd volume volume-96161016-d59e-4579-b4c2-6215c2dc63be {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:42.756415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1976094b-0c98-45de-ac05-012c5fdb3209 tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:43.119149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Created reservations ['7363f598-4098-4281-a006-bb97b46f89f8', 'ae2925ef-b75b-45c9-8cd4-b5003d65b217', '1e441aa1-7f8a-4a8d-8ade-b94fc93923f4', '7adc3dd8-f51f-4e1a-8f1c-9a5c055db475'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:43.158926 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:43.181319 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:43.211565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:43.215990 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Deleted volume successfully. Nov 27 21:23:43.227606 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-11393cdc-b64f-4a6c-9e72-d0558ac0ad53 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-96161016-d59e-4579-b4c2-6215c2dc63be-delete_volume'" released by "delete_volume" :: held 0.949s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:43.789694 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1976094b-0c98-45de-ac05-012c5fdb3209 tempest-VolumesSnapshotListTestJSON-220301814 None] Create snapshot completed successfully Nov 27 21:23:44.510009 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-70893a5c-b091-4700-bd50-978ce73dc56b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:44.568102 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:44.745110 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] deleting rbd volume volume-70893a5c-b091-4700-bd50-978ce73dc56b {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:44.759549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-771a1bbc-9b8a-41e7-a2cc-1d7f4be233e6 tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:44.922058 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:23:44.951293 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] deleting parent snapshot volume-70893a5c-b091-4700-bd50-978ce73dc56b.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:23:45.817502 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] Created reservations ['ad36169e-c876-465d-89c2-099313c31628', 'ffde3d8f-8231-4b0f-8700-5d4a73cce33a', '6a9ec8c3-fbee-4797-b70f-e0a0ee4889b6', '087072bf-bd1f-49f6-af61-70e6c4b19d32'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:45.839343 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-771a1bbc-9b8a-41e7-a2cc-1d7f4be233e6 tempest-VolumesSnapshotListTestJSON-220301814 None] Create snapshot completed successfully Nov 27 21:23:45.868387 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:45.890247 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:45.912831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:45.916836 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] Deleted volume successfully. Nov 27 21:23:45.928662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-828350e3-d74b-424d-80f4-d026675baff0 tempest-VolumesBackupsTest-1517995977 None] Lock "b'cinder-70893a5c-b091-4700-bd50-978ce73dc56b-delete_volume'" released by "delete_volume" :: held 1.420s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:47.266360 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-df244150-87c2-4a03-8d2b-8557a738b994 tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-5f5754eb-fc6b-4d53-8cb1-d93a68164f1f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:47.267977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-df244150-87c2-4a03-8d2b-8557a738b994 tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:47.827717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-df244150-87c2-4a03-8d2b-8557a738b994 tempest-VolumesSnapshotListTestJSON-220301814 None] Created reservations ['89e8e865-96ad-4efa-b29d-bd62fb868adc', '28f84b39-0025-42f9-86b5-e01452bd1a54', 'c9d8734a-6135-4fff-bb37-18f62d1cd2c0', '13f4f3a5-a5ec-4170-b94f-f3b72d76aa11'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:47.863583 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-df244150-87c2-4a03-8d2b-8557a738b994 tempest-VolumesSnapshotListTestJSON-220301814 None] Delete snapshot completed successfully. Nov 27 21:23:47.868489 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-df244150-87c2-4a03-8d2b-8557a738b994 tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-5f5754eb-fc6b-4d53-8cb1-d93a68164f1f-delete_snapshot'" released by "delete_snapshot" :: held 0.602s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:48.363983 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b67e0ccb-6f15-486e-b0a7-cfc49b34319c tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-5a619a7a-a206-4bfd-916d-f883cbf56fbb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:48.366429 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b67e0ccb-6f15-486e-b0a7-cfc49b34319c tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:48.865075 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-b67e0ccb-6f15-486e-b0a7-cfc49b34319c tempest-VolumesSnapshotListTestJSON-220301814 None] Created reservations ['48ee0e16-ed81-40a8-8908-ada87455d304', '99a437d9-b3b7-46d6-b29b-697209bedf6f', '0b3bab8d-ec20-4ea4-81bb-c14f84b932cf', '386ba4ee-ae8c-41e0-a6b3-e23af231caf2'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:48.906089 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b67e0ccb-6f15-486e-b0a7-cfc49b34319c tempest-VolumesSnapshotListTestJSON-220301814 None] Delete snapshot completed successfully. Nov 27 21:23:48.914521 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-b67e0ccb-6f15-486e-b0a7-cfc49b34319c tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-5a619a7a-a206-4bfd-916d-f883cbf56fbb-delete_snapshot'" released by "delete_snapshot" :: held 0.551s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:49.506652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-8797f1a8-0378-4e4b-8a17-70dff1318f6d tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-8c19fb77-6d4e-4eae-ab7a-671f3c74d699-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:49.509827 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-8797f1a8-0378-4e4b-8a17-70dff1318f6d tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:49.873829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-8797f1a8-0378-4e4b-8a17-70dff1318f6d tempest-VolumesSnapshotListTestJSON-220301814 None] Created reservations ['a1d5e029-c8db-4ba9-ac45-b51f20525382', 'd095b242-e4b1-455b-9f23-59c9f0988ff3', '7b94e4b2-3aa9-4f71-8ed9-226f3a11a738', 'bd25b552-97ab-4e0a-bafc-3176c4c5a15c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:49.910761 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-8797f1a8-0378-4e4b-8a17-70dff1318f6d tempest-VolumesSnapshotListTestJSON-220301814 None] Delete snapshot completed successfully. Nov 27 21:23:49.915708 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-8797f1a8-0378-4e4b-8a17-70dff1318f6d tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-8c19fb77-6d4e-4eae-ab7a-671f3c74d699-delete_snapshot'" released by "delete_snapshot" :: held 0.409s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:50.723841 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-81380aaf-faa0-415e-a532-7be1a8ec3780-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:50.801048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:50.867932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:50.868650 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Volume volume-81380aaf-faa0-415e-a532-7be1a8ec3780 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:50.874521 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] deleting rbd volume volume-81380aaf-faa0-415e-a532-7be1a8ec3780 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:51.149620 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Created reservations ['4a0dc928-b7ad-48f8-9c34-7357ec5336de', 'cc33205d-6152-433d-8499-ce17c07bd9f5', '7331d8a0-b231-4f64-9548-c50937d465d3', 'f3c2f6c5-01b0-436c-bee3-f1ca9b27a3b6'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:51.207061 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:51.251789 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:51.284835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:51.294060 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Deleted volume successfully. Nov 27 21:23:51.309824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-7c941eda-ade9-4ca4-aafc-e05e8d338f1c tempest-VolumesSnapshotListTestJSON-220301814 None] Lock "b'cinder-81380aaf-faa0-415e-a532-7be1a8ec3780-delete_volume'" released by "delete_volume" :: held 0.586s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:54.527390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:23:54.538540 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:23:54.539042 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:23:54.559099 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Flow 'volume_create_manager' (b22ae0f8-c0b9-4cdf-b89f-61f2a39fb753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:54.562370 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7417071-07c4-4628-b955-56e8c38c2723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.568983 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:23:54.583652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7417071-07c4-4628-b955-56e8c38c2723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-567382986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1ab2284-de57-4bb1-91de-882d909e85c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50c27f6a8ff4c60b0c83b539eae25f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:23:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:23:54Z,use_quota=True,user_id='c452ab8d57c949b584bca2ead06fff01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.587347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06db0e-e0a8-4f08-80da-f5f1fca4e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.590760 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06db0e-e0a8-4f08-80da-f5f1fca4e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.596783 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce01316-46d1-4f63-b629-e2a446d1e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.600540 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce01316-46d1-4f63-b629-e2a446d1e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ab2284-de57-4bb1-91de-882d909e85c1', 'volume_name': 'volume-f1ab2284-de57-4bb1-91de-882d909e85c1', 'volume_size': 2}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.603831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db3373e-2fc6-4a37-904a-c8d0bdfbfda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.606762 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db3373e-2fc6-4a37-904a-c8d0bdfbfda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.609736 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f955e6-66a6-41de-ab82-a83d27bc9add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.610821 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Volume f1ab2284-de57-4bb1-91de-882d909e85c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ab2284-de57-4bb1-91de-882d909e85c1', 'volume_size': 2} Nov 27 21:23:54.611431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] creating volume 'volume-f1ab2284-de57-4bb1-91de-882d909e85c1' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:23:54.612767 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:54.699815 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:23:54.700615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:23:54.703007 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f955e6-66a6-41de-ab82-a83d27bc9add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ab2284-de57-4bb1-91de-882d909e85c1', 'volume_size': 2}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.706020 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e563df8-b2cc-4b92-b3f8-9e6ef55b5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:23:54.715729 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Volume volume-f1ab2284-de57-4bb1-91de-882d909e85c1 (f1ab2284-de57-4bb1-91de-882d909e85c1): created successfully Nov 27 21:23:54.718682 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e563df8-b2cc-4b92-b3f8-9e6ef55b5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:23:54.724261 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Flow 'volume_create_manager' (b22ae0f8-c0b9-4cdf-b89f-61f2a39fb753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:23:54.734976 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-7e7a1ea2-cf64-4a53-81f0-890759c39a02 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Created volume successfully. Nov 27 21:23:55.840963 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-b4374f44-486c-4544-a9c8-2fdf85fba5d3 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:56.807913 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-b4374f44-486c-4544-a9c8-2fdf85fba5d3 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Create snapshot completed successfully Nov 27 21:23:57.041505 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-af47f1b9-e7b7-4a67-bd2e-3d6b7ac49106 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Lock "b'cinder-ac0ec51e-6407-4bb8-ade5-da025d558a7b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:57.043999 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-af47f1b9-e7b7-4a67-bd2e-3d6b7ac49106 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:57.845081 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-af47f1b9-e7b7-4a67-bd2e-3d6b7ac49106 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Created reservations ['f7a950a7-5c86-4fae-8726-08bf6033d752', 'bd94f505-6476-4fcc-805b-bf178a1ec45c', '366afaec-7b76-4574-9406-0b0f395ad7cc', '2f6f7cd6-f3f6-4a25-b061-0e4bcdaca311'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:57.925104 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:23:57.926507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:57.990116 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:58.044649 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:58.048084 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-af47f1b9-e7b7-4a67-bd2e-3d6b7ac49106 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Delete snapshot completed successfully. Nov 27 21:23:58.055878 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-af47f1b9-e7b7-4a67-bd2e-3d6b7ac49106 tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Lock "b'cinder-ac0ec51e-6407-4bb8-ade5-da025d558a7b-delete_snapshot'" released by "delete_snapshot" :: held 1.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:23:58.207919 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Lock "b'cinder-f1ab2284-de57-4bb1-91de-882d909e85c1-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:23:58.257499 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:58.308620 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:23:58.309493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Volume volume-f1ab2284-de57-4bb1-91de-882d909e85c1 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:23:58.317668 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] deleting rbd volume volume-f1ab2284-de57-4bb1-91de-882d909e85c1 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:23:58.702619 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Created reservations ['7b429484-fdc6-4ec2-8b9d-7d54cec16776', 'e9b77e83-a677-4ae2-8f15-64745cd20d14', '1ccd8f4b-74e3-4a6c-a643-7c8a4695f566', '96a0da72-0870-4309-bba6-8e61794aebcd'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:23:58.749049 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:58.796539 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:23:58.829870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:23:58.834610 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Deleted volume successfully. Nov 27 21:23:58.849319 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-a8a223c4-a1cb-40e5-9236-8546f518605c tempest-VolumesSnapshotNegativeTestJSON-1163212899 None] Lock "b'cinder-f1ab2284-de57-4bb1-91de-882d909e85c1-delete_volume'" released by "delete_volume" :: held 0.641s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:24:57.924597 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:24:57.925339 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:24:57.962264 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:24:57.987812 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:25:03.993759 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:25:03.997016 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:25:03.997475 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:25:04.010926 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (ad180d7a-f029-45c6-baca-1e1ff826871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:04.014797 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19b7d3a-2a81-4419-b40c-9f5085365cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:04.021337 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:25:04.034129 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19b7d3a-2a81-4419-b40c-9f5085365cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-127332582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26eb88d3-3900-4d04-9b67-1cc1399faf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:25:04Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:04.036741 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8875edc2-16c5-41b5-84f5-66ca20687de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:04.038907 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8875edc2-16c5-41b5-84f5-66ca20687de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:04.041341 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4772c5b-9001-441c-aedf-894cc1c2a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:04.127716 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4772c5b-9001-441c-aedf-894cc1c2a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26eb88d3-3900-4d04-9b67-1cc1399faf20', 'volume_name': 'volume-26eb88d3-3900-4d04-9b67-1cc1399faf20', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:04.130149 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f36ca-de60-48e3-b495-8939afa43566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:04.132393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f36ca-de60-48e3-b495-8939afa43566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:04.134778 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e63845-d7dd-4cc3-9a14-3cdf526bd54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:04.135502 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Volume 26eb88d3-3900-4d04-9b67-1cc1399faf20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26eb88d3-3900-4d04-9b67-1cc1399faf20', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:25:04.136317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Cloning 26eb88d3-3900-4d04-9b67-1cc1399faf20 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:25:04.145248 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:25:04.156268 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 25, 4, 151474)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:25:04.157261 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:25:04.157664 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:25:04.162255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:25:04.163228 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:25:04.168720 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 25, 4, 166518)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:25:04.169138 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:25:04.169540 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:25:04.181759 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:04.234283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] creating snapshot='volume-26eb88d3-3900-4d04-9b67-1cc1399faf20.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:25:04.710043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-26eb88d3-3900-4d04-9b67-1cc1399faf20.clone_snap' to 'volume-26eb88d3-3900-4d04-9b67-1cc1399faf20' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:25:04.889586 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:25:04.890757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:25:04.891908 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:25:04.920395 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:25:04.921275 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Marking volume 26eb88d3-3900-4d04-9b67-1cc1399faf20 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:25:04.932439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 26eb88d3-3900-4d04-9b67-1cc1399faf20. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:25:04.933334 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Creating volume glance metadata for volume 26eb88d3-3900-4d04-9b67-1cc1399faf20 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:25:05.015050 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e63845-d7dd-4cc3-9a14-3cdf526bd54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26eb88d3-3900-4d04-9b67-1cc1399faf20', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:05.018136 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abd4bd4-48c5-4103-8db3-0513a116b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:05.029762 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Volume volume-26eb88d3-3900-4d04-9b67-1cc1399faf20 (26eb88d3-3900-4d04-9b67-1cc1399faf20): created successfully Nov 27 21:25:05.033224 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abd4bd4-48c5-4103-8db3-0513a116b36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:05.036978 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (ad180d7a-f029-45c6-baca-1e1ff826871f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:05.045983 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-99346fd4-f8f7-42cc-a79f-9d5a0b8c6ca2 tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:25:06.464347 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-36898961-658b-4c54-9ec1-6ffd962b43a7 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:06.906445 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-36898961-658b-4c54-9ec1-6ffd962b43a7 tempest-TestVolumeBootPattern-1822676883 None] Create snapshot completed successfully Nov 27 21:25:10.117391 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:25:10.121466 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:25:10.121668 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:25:10.144028 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (d1673059-3bb8-4e05-9e7e-b522927a1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:10.147159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f9ec6-b8a4-42b9-8301-9cfc090008e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.153435 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:25:10.166552 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f9ec6-b8a4-42b9-8301-9cfc090008e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:25:10Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b805d42-ea8e-4ad6-a014-727a3ef56792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cecccd8d-335b-4cd7-8fed-3c646fd55ff4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:25:10Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.169158 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b0a2a5-8f5f-488c-8327-3ffe08cd5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.171305 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b0a2a5-8f5f-488c-8327-3ffe08cd5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.174365 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd441a8-e2cd-4bfb-b733-974cf23f2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.176608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd441a8-e2cd-4bfb-b733-974cf23f2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b805d42-ea8e-4ad6-a014-727a3ef56792', 'volume_name': 'volume-1b805d42-ea8e-4ad6-a014-727a3ef56792', 'volume_size': 1, 'snapshot_id': 'cecccd8d-335b-4cd7-8fed-3c646fd55ff4'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.178891 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee15b78-1d5d-40e7-8c6d-1e694fc45f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.181034 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee15b78-1d5d-40e7-8c6d-1e694fc45f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.183234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34920aeb-8720-4abd-afb3-45b71b3dcffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.184034 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Volume 1b805d42-ea8e-4ad6-a014-727a3ef56792: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b805d42-ea8e-4ad6-a014-727a3ef56792', 'volume_size': 1, 'snapshot_id': 'cecccd8d-335b-4cd7-8fed-3c646fd55ff4'} Nov 27 21:25:10.201469 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] cloning volumes/volume-26eb88d3-3900-4d04-9b67-1cc1399faf20@snapshot-cecccd8d-335b-4cd7-8fed-3c646fd55ff4 to volume-1b805d42-ea8e-4ad6-a014-727a3ef56792 {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:25:10.202308 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:10.271032 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:10.421780 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:25:10.422113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:25:10.443714 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Marking volume 1b805d42-ea8e-4ad6-a014-727a3ef56792 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:25:10.449243 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from snapshot cecccd8d-335b-4cd7-8fed-3c646fd55ff4 to 1b805d42-ea8e-4ad6-a014-727a3ef56792. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 27 21:25:10.487070 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34920aeb-8720-4abd-afb3-45b71b3dcffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b805d42-ea8e-4ad6-a014-727a3ef56792', 'volume_size': 1, 'snapshot_id': 'cecccd8d-335b-4cd7-8fed-3c646fd55ff4'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.489547 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ebe9b3-857c-4ecc-81db-755e3e83bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:10.497364 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Volume volume-1b805d42-ea8e-4ad6-a014-727a3ef56792 (1b805d42-ea8e-4ad6-a014-727a3ef56792): created successfully Nov 27 21:25:10.499157 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ebe9b3-857c-4ecc-81db-755e3e83bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:10.503608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (d1673059-3bb8-4e05-9e7e-b522927a1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:10.518678 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-23652c0f-33f9-4411-bf46-486f857d0bdb tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:25:13.428532 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-76b68b82-3729-4bd5-bc7a-c83bad169b27 tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:25:14.064848 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-76b68b82-3729-4bd5-bc7a-c83bad169b27 tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:25:14.065500 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-76b68b82-3729-4bd5-bc7a-c83bad169b27 tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b805d42-ea8e-4ad6-a014-727a3ef56792', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '1b805d42-ea8e-4ad6-a014-727a3ef56792', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:25:14.086760 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-76b68b82-3729-4bd5-bc7a-c83bad169b27 tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-1b805d42-ea8e-4ad6-a014-727a3ef56792', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b805d42-ea8e-4ad6-a014-727a3ef56792', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0f6fc310-7731-4214-9367-504e8e118d32'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:25:14.133508 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 req-76b68b82-3729-4bd5-bc7a-c83bad169b27 tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:25:26.700618 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-bb714f60-0240-4cec-90ca-e4864c582901 req-1fc95f34-10f1-45bc-ad3e-9095d14aff5d tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:25:26.701285 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-bb714f60-0240-4cec-90ca-e4864c582901 req-1fc95f34-10f1-45bc-ad3e-9095d14aff5d tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment 0f6fc310-7731-4214-9367-504e8e118d32. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:25:26.841008 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-1b805d42-ea8e-4ad6-a014-727a3ef56792-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:25:26.874142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:26.958105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:25:26.965142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-1b805d42-ea8e-4ad6-a014-727a3ef56792 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:25:27.162018 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['3dccba0a-cc6c-4090-8370-d244aaed9b3a', '52226eeb-c9af-4805-836d-8bb42860a016', '002e212d-0c62-4f89-be44-dc313f32c3cc', '9125d78b-2389-4c0c-addd-33b48f4d4cf9'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:25:27.207355 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:27.230319 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:27.254451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:25:27.258996 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:25:27.270707 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-bb714f60-0240-4cec-90ca-e4864c582901 req-98887710-aa22-4ecf-abdd-8cb67eb91e09 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-1b805d42-ea8e-4ad6-a014-727a3ef56792-delete_volume'" released by "delete_volume" :: held 0.430s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:25:28.106086 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-27e6ed55-4b38-42cf-9e81-2fd65a604fbf tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-cecccd8d-335b-4cd7-8fed-3c646fd55ff4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:25:28.107635 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-27e6ed55-4b38-42cf-9e81-2fd65a604fbf tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:28.841865 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-27e6ed55-4b38-42cf-9e81-2fd65a604fbf tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['c1b3cabe-d066-4abc-b274-2aa3df7eb9bc', '865c23af-6c12-4f7e-b271-d786bd11e206', 'e11563ea-648c-4740-bb59-2d962ecb7953', '03bf8b72-3683-4db9-b07a-bc4a72ad075b'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:25:28.880749 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-27e6ed55-4b38-42cf-9e81-2fd65a604fbf tempest-TestVolumeBootPattern-1822676883 None] Delete snapshot completed successfully. Nov 27 21:25:28.885234 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-27e6ed55-4b38-42cf-9e81-2fd65a604fbf tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-cecccd8d-335b-4cd7-8fed-3c646fd55ff4-delete_snapshot'" released by "delete_snapshot" :: held 0.779s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:25:29.208752 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-26eb88d3-3900-4d04-9b67-1cc1399faf20-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:25:29.239766 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:29.300756 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:25:29.307920 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-26eb88d3-3900-4d04-9b67-1cc1399faf20 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:25:29.476863 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:25:29.508352 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] deleting parent snapshot volume-26eb88d3-3900-4d04-9b67-1cc1399faf20.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:25:29.847490 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['566485f2-9cad-48df-ad7a-25bd2665c01f', 'b6bef5a3-c559-447c-a01f-2de6bd171d5d', '3526b7dd-9e10-4753-8bac-d5677f1b6718', '2943dfc8-6719-4dd5-b5fa-92af0aff9274'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:25:29.887701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:29.909990 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:29.931759 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:25:29.935955 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:25:29.947535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-21c06581-391e-4bae-953a-80529bbbbbf0 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-26eb88d3-3900-4d04-9b67-1cc1399faf20-delete_volume'" released by "delete_volume" :: held 0.739s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:25:30.693255 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:25:30.696855 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:25:30.697385 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:25:30.709804 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (eee8f854-c726-4fd7-9cd9-540ce53a9759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:30.713167 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edde30-0c9d-4018-9c4a-d445d23332ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:30.719563 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:25:30.731692 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edde30-0c9d-4018-9c4a-d445d23332ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1395059149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=47179aba-1206-4495-8631-f54d46f24132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:25:31Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:30.734290 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de05b05-94c7-4801-9f30-cfc10ad2d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:30.737264 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de05b05-94c7-4801-9f30-cfc10ad2d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:30.739775 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d3c16-ae23-4ad4-bdd0-100b7bbe88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:30.821165 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d3c16-ae23-4ad4-bdd0-100b7bbe88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47179aba-1206-4495-8631-f54d46f24132', 'volume_name': 'volume-47179aba-1206-4495-8631-f54d46f24132', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:30.823605 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e01e2e-3d71-4a77-85e0-49c2e5141a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:30.825828 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e01e2e-3d71-4a77-85e0-49c2e5141a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:30.828170 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c04c6-c782-4ac1-90c0-38e9e54076bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:30.829007 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Volume 47179aba-1206-4495-8631-f54d46f24132: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47179aba-1206-4495-8631-f54d46f24132', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:25:30.829613 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Cloning 47179aba-1206-4495-8631-f54d46f24132 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:25:30.838540 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:25:30.848829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 25, 30, 842958)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:25:30.849309 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:25:30.849706 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:25:30.853776 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:25:30.854666 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:25:30.859980 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 25, 30, 857824)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:25:30.860389 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:25:30.860785 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:25:30.872623 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:30.923270 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] creating snapshot='volume-47179aba-1206-4495-8631-f54d46f24132.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:25:31.832466 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-47179aba-1206-4495-8631-f54d46f24132.clone_snap' to 'volume-47179aba-1206-4495-8631-f54d46f24132' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:25:31.956667 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:25:31.957834 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:25:31.958229 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:25:31.975932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:25:31.976550 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Marking volume 47179aba-1206-4495-8631-f54d46f24132 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:25:31.984036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 47179aba-1206-4495-8631-f54d46f24132. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:25:31.984469 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Creating volume glance metadata for volume 47179aba-1206-4495-8631-f54d46f24132 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:25:32.034719 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c04c6-c782-4ac1-90c0-38e9e54076bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47179aba-1206-4495-8631-f54d46f24132', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:32.036965 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7184d89f-8ca4-4b0c-91e0-93950b99b8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:32.043884 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Volume volume-47179aba-1206-4495-8631-f54d46f24132 (47179aba-1206-4495-8631-f54d46f24132): created successfully Nov 27 21:25:32.045738 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7184d89f-8ca4-4b0c-91e0-93950b99b8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:32.048687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (eee8f854-c726-4fd7-9cd9-540ce53a9759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:32.055472 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-6aa690dc-5b8a-4fd5-b7fa-37106339fd5e tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:25:34.596803 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c req-c5f39e5b-711c-4469-9279-77094362cd5c tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:25:35.256518 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c req-c5f39e5b-711c-4469-9279-77094362cd5c tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.659s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:25:35.257413 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c req-c5f39e5b-711c-4469-9279-77094362cd5c tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47179aba-1206-4495-8631-f54d46f24132', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '47179aba-1206-4495-8631-f54d46f24132', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:25:35.284018 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c req-c5f39e5b-711c-4469-9279-77094362cd5c tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-47179aba-1206-4495-8631-f54d46f24132', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '47179aba-1206-4495-8631-f54d46f24132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7701450c-67be-4a0f-a011-4da41be00816'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:25:35.344876 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c req-c5f39e5b-711c-4469-9279-77094362cd5c tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:25:45.907300 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-6eec41db-fb4b-4572-886d-806b55316ed7 req-c28623ba-3944-424f-b90f-e0fb7e025fac tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:46.785866 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-6eec41db-fb4b-4572-886d-806b55316ed7 req-c28623ba-3944-424f-b90f-e0fb7e025fac tempest-TestVolumeBootPattern-1822676883 None] Create snapshot completed successfully Nov 27 21:25:49.673297 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:25:49.677841 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:25:49.678405 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:25:49.701131 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (671cd0a3-6607-4fa1-920e-a4eadea2d984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:49.704374 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055da4a0-68f7-4073-b296-a6930a24a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:49.710554 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:25:49.723477 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055da4a0-68f7-4073-b296-a6930a24a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:25:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b372d9de-8306-4670-a614-15ac1d4628d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de8b445e-501a-46a6-8931-ad205722da94,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:25:50Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:49.726059 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eadd8d4-9f30-4481-a2cb-c3d7068526f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:49.728249 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eadd8d4-9f30-4481-a2cb-c3d7068526f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:49.730838 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d69822-78aa-41de-a7ee-108632e571f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:49.734098 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d69822-78aa-41de-a7ee-108632e571f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b372d9de-8306-4670-a614-15ac1d4628d9', 'volume_name': 'volume-b372d9de-8306-4670-a614-15ac1d4628d9', 'volume_size': 1, 'snapshot_id': 'de8b445e-501a-46a6-8931-ad205722da94'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:49.737615 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7600c8fa-3af5-4213-a6e2-78bdcacb1c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:49.740449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7600c8fa-3af5-4213-a6e2-78bdcacb1c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:49.742629 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1d35b0-4bde-4d5b-90c7-9ed40a2e0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:49.743627 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Volume b372d9de-8306-4670-a614-15ac1d4628d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b372d9de-8306-4670-a614-15ac1d4628d9', 'volume_size': 1, 'snapshot_id': 'de8b445e-501a-46a6-8931-ad205722da94'} Nov 27 21:25:49.767452 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] cloning volumes/volume-47179aba-1206-4495-8631-f54d46f24132@snapshot-de8b445e-501a-46a6-8931-ad205722da94 to volume-b372d9de-8306-4670-a614-15ac1d4628d9 {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:25:49.768458 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:49.852478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:50.026871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:25:50.027400 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:25:50.049177 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Marking volume b372d9de-8306-4670-a614-15ac1d4628d9 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:25:50.053757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from snapshot de8b445e-501a-46a6-8931-ad205722da94 to b372d9de-8306-4670-a614-15ac1d4628d9. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 27 21:25:50.086088 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1d35b0-4bde-4d5b-90c7-9ed40a2e0bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b372d9de-8306-4670-a614-15ac1d4628d9', 'volume_size': 1, 'snapshot_id': 'de8b445e-501a-46a6-8931-ad205722da94'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:50.088289 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c9b63-7c38-47c2-8298-c06423f11633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:25:50.097179 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Volume volume-b372d9de-8306-4670-a614-15ac1d4628d9 (b372d9de-8306-4670-a614-15ac1d4628d9): created successfully Nov 27 21:25:50.100311 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950c9b63-7c38-47c2-8298-c06423f11633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:25:50.103530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (671cd0a3-6607-4fa1-920e-a4eadea2d984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:25:50.117631 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-71ce3a2c-32e5-44d9-a2bf-78e261191e24 tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:25:52.898997 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-1f233125-0c01-4c1c-9957-f8b10da2a636 tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:25:53.620385 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-1f233125-0c01-4c1c-9957-f8b10da2a636 tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.721s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:25:53.621178 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-1f233125-0c01-4c1c-9957-f8b10da2a636 tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b372d9de-8306-4670-a614-15ac1d4628d9', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'b372d9de-8306-4670-a614-15ac1d4628d9', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:25:53.648057 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-1f233125-0c01-4c1c-9957-f8b10da2a636 tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-b372d9de-8306-4670-a614-15ac1d4628d9', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b372d9de-8306-4670-a614-15ac1d4628d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a9926981-6e7e-4709-bf09-e7d317177fb0'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:25:53.695276 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde req-1f233125-0c01-4c1c-9957-f8b10da2a636 tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:25:57.923341 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:25:57.924889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:57.953997 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:25:57.978407 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:26:05.493145 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-aa1a3682-bf4d-4cd4-b107-24771d4a802c tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:26:05.493794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-aa1a3682-bf4d-4cd4-b107-24771d4a802c tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment a9926981-6e7e-4709-bf09-e7d317177fb0. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:26:05.711114 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-b372d9de-8306-4670-a614-15ac1d4628d9-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:26:05.776908 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:05.904221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:26:05.936993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-b372d9de-8306-4670-a614-15ac1d4628d9 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:26:06.391966 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['7534b754-2794-4c0c-939e-7e9a0488f8ca', '5c145105-7a87-47ea-bb79-08710a75c3eb', 'd655fa34-232e-4e33-8bcb-08dd170782c9', '98f9add7-2d2e-412d-bbbe-042a6bce73c0'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:26:06.461579 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:06.512806 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:06.579764 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:26:06.586540 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:26:06.606093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b req-382a5071-6f9e-4da6-b9b8-24ef0a802518 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-b372d9de-8306-4670-a614-15ac1d4628d9-delete_volume'" released by "delete_volume" :: held 0.895s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:26:07.359960 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-141af04b-5078-4bea-8e9c-c78705a4ef80 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-de8b445e-501a-46a6-8931-ad205722da94-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:26:07.362049 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-141af04b-5078-4bea-8e9c-c78705a4ef80 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:37.542131 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-141af04b-5078-4bea-8e9c-c78705a4ef80 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['412d02fc-ae1b-46a9-8f41-beea959ab87c', '23a5e067-1615-45d8-bec3-09028224a661', 'c8d07748-43e1-40be-a9ea-6f27ab0f14d2', 'f1ac0f68-7cf7-4a05-b0ff-3b433223ac53'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:26:37.579023 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-141af04b-5078-4bea-8e9c-c78705a4ef80 tempest-TestVolumeBootPattern-1822676883 None] Delete snapshot completed successfully. Nov 27 21:26:37.584728 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-141af04b-5078-4bea-8e9c-c78705a4ef80 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-de8b445e-501a-46a6-8931-ad205722da94-delete_snapshot'" released by "delete_snapshot" :: held 30.225s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:26:40.733238 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-964d1a85-e563-40df-8af3-78182ff968e6 tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:26:40.733967 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-964d1a85-e563-40df-8af3-78182ff968e6 tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment 7701450c-67be-4a0f-a011-4da41be00816. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:26:40.866024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-47179aba-1206-4495-8631-f54d46f24132-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:26:40.896451 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:40.975931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:26:40.984242 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-47179aba-1206-4495-8631-f54d46f24132 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:26:41.202960 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:26:41.235776 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] deleting parent snapshot volume-47179aba-1206-4495-8631-f54d46f24132.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:26:41.790614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['c7d295a4-2829-46af-8329-e9dd2abc6dd2', '198c186d-f3b3-4b0f-a830-4fa67848d554', 'f3d68562-72be-44ae-808a-14e25fe0362a', '4f648ba4-aceb-453e-a73b-4dd1004f821c'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:26:41.831504 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:41.853912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:41.889204 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:26:41.896645 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:26:41.909393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-fe8d0679-3b04-4992-a21d-1928b1005eaa req-4c066963-5122-402e-90fa-06b8a8edca19 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-47179aba-1206-4495-8631-f54d46f24132-delete_volume'" released by "delete_volume" :: held 1.043s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:26:43.942673 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:26:43.946892 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:26:43.947411 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:26:43.959415 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (40e85c87-7a8e-48ae-9154-a053f30ffe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:26:43.964955 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62431d6-c16d-4a7a-a5d9-f6b158014b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:43.970973 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:26:43.983036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62431d6-c16d-4a7a-a5d9-f6b158014b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-875240501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03079e0b-c8b5-4a98-beae-24c4370e0212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:26:44Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:43.985630 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1996f5a3-c3d4-415d-aa31-ad46290513ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:43.987776 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1996f5a3-c3d4-415d-aa31-ad46290513ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:43.990416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9337a1-95b8-4dca-9d47-2313d4e4d8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:44.067870 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9337a1-95b8-4dca-9d47-2313d4e4d8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03079e0b-c8b5-4a98-beae-24c4370e0212', 'volume_name': 'volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:44.070283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c9e28f-52b1-4110-85b7-2326783edc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:44.073060 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c9e28f-52b1-4110-85b7-2326783edc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:44.075385 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1736a896-880e-4836-8e91-47cf607461e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:44.076219 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Volume 03079e0b-c8b5-4a98-beae-24c4370e0212: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:26:44.076796 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Cloning 03079e0b-c8b5-4a98-beae-24c4370e0212 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:26:44.084777 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:26:44.093904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 26, 44, 88708)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:26:44.094507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:26:44.094906 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:26:44.098978 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:26:44.099873 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:26:44.105902 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 26, 44, 103765)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:26:44.106318 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:26:44.106716 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:26:44.118549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:44.166872 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] creating snapshot='volume-03079e0b-c8b5-4a98-beae-24c4370e0212.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:26:44.266583 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-03079e0b-c8b5-4a98-beae-24c4370e0212.clone_snap' to 'volume-03079e0b-c8b5-4a98-beae-24c4370e0212' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:26:44.390824 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:26:44.392035 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:26:44.392420 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:26:44.408228 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:26:44.408854 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Marking volume 03079e0b-c8b5-4a98-beae-24c4370e0212 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:26:44.416854 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 03079e0b-c8b5-4a98-beae-24c4370e0212. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:26:44.417336 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Creating volume glance metadata for volume 03079e0b-c8b5-4a98-beae-24c4370e0212 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:26:44.467622 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1736a896-880e-4836-8e91-47cf607461e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:44.470168 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef65dc7-1af2-4ab4-9d8c-ab7750f00175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:26:44.478294 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Volume volume-03079e0b-c8b5-4a98-beae-24c4370e0212 (03079e0b-c8b5-4a98-beae-24c4370e0212): created successfully Nov 27 21:26:44.480599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef65dc7-1af2-4ab4-9d8c-ab7750f00175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:26:44.483667 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (40e85c87-7a8e-48ae-9154-a053f30ffe6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:26:44.491268 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-0c3c2644-2736-4b9e-879d-4b7819638b96 tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:26:47.182483 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 req-dd824547-7963-4dc8-bc74-2c18a766a6b4 tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:26:47.842394 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 req-dd824547-7963-4dc8-bc74-2c18a766a6b4 tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.660s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:26:47.843390 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 req-dd824547-7963-4dc8-bc74-2c18a766a6b4 tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '03079e0b-c8b5-4a98-beae-24c4370e0212', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:26:47.873911 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 req-dd824547-7963-4dc8-bc74-2c18a766a6b4 tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03079e0b-c8b5-4a98-beae-24c4370e0212', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cfdf09c-e0f9-4c4f-ac97-fc7fdb7fd211'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:26:47.946147 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 req-dd824547-7963-4dc8-bc74-2c18a766a6b4 tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:26:57.925181 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:26:57.926189 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:57.960827 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:26:58.001495 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:27:52.773459 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:27:52.777029 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:27:52.777520 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:27:52.790416 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Flow 'volume_create_manager' (f12646f1-0df2-4d5a-9dd9-aaaa0abef68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:27:52.793743 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457075fd-58a0-47ff-90d3-aa0af5a53f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:52.800116 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:27:52.816456 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457075fd-58a0-47ff-90d3-aa0af5a53f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-552378048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=895f0bf1-7373-4777-9163-1d0dff41ae31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34545818a5a9484a943ab6e09bdd800a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:27:53Z,use_quota=True,user_id='011c76eca940449f865a90106ed59c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:52.820778 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872994f4-e7df-454b-b8df-0151398a5da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:52.823570 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872994f4-e7df-454b-b8df-0151398a5da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:52.825967 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c950f0-dae5-4e43-99d8-58fade669904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:52.907283 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c950f0-dae5-4e43-99d8-58fade669904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '895f0bf1-7373-4777-9163-1d0dff41ae31', 'volume_name': 'volume-895f0bf1-7373-4777-9163-1d0dff41ae31', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:52.910058 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95de552-0b7e-49fe-a898-140b9ddfeddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:52.912246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95de552-0b7e-49fe-a898-140b9ddfeddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:52.914526 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e3d3b9-ff22-4948-bf76-b85a4f598ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:52.915400 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Volume 895f0bf1-7373-4777-9163-1d0dff41ae31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-895f0bf1-7373-4777-9163-1d0dff41ae31', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 21:27:52.916040 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Cloning 895f0bf1-7373-4777-9163-1d0dff41ae31 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 21:27:52.925040 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:27:52.937365 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 27, 52, 931142)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:27:52.937858 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:27:52.938332 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 21:27:52.943135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:27:52.944103 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 21:27:52.950093 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 21, 27, 52, 947331)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 21:27:52.950503 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 21:27:52.950892 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 21:27:52.962030 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:27:53.014369 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] creating snapshot='volume-895f0bf1-7373-4777-9163-1d0dff41ae31.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 21:27:53.657905 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-895f0bf1-7373-4777-9163-1d0dff41ae31.clone_snap' to 'volume-895f0bf1-7373-4777-9163-1d0dff41ae31' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 21:27:53.840519 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:27:53.841712 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:27:53.842439 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:27:53.872064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 21:27:53.872749 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Marking volume 895f0bf1-7373-4777-9163-1d0dff41ae31 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:27:53.886671 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 895f0bf1-7373-4777-9163-1d0dff41ae31. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 21:27:53.887101 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Creating volume glance metadata for volume 895f0bf1-7373-4777-9163-1d0dff41ae31 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 21:27:53.948135 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e3d3b9-ff22-4948-bf76-b85a4f598ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895f0bf1-7373-4777-9163-1d0dff41ae31', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:53.951051 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d6ed04-e552-4e8c-a415-ba661f63fc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:27:53.960964 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Volume volume-895f0bf1-7373-4777-9163-1d0dff41ae31 (895f0bf1-7373-4777-9163-1d0dff41ae31): created successfully Nov 27 21:27:53.963735 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d6ed04-e552-4e8c-a415-ba661f63fc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:27:53.967150 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Flow 'volume_create_manager' (f12646f1-0df2-4d5a-9dd9-aaaa0abef68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:27:53.977174 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-05d0f4f4-62c3-41e4-869a-94d87f249d22 tempest-TestVolumeBackupRestore-900720088 None] Created volume successfully. Nov 27 21:27:55.241976 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:27:55.906316 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.664s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:27:55.907048 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-895f0bf1-7373-4777-9163-1d0dff41ae31', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '895f0bf1-7373-4777-9163-1d0dff41ae31', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:27:55.921934 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] Initialize volume connection completed successfully. Nov 27 21:27:57.927603 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:27:57.928884 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:27:57.970485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:27:58.008684 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:27:59.920470 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] Terminate volume connection completed successfully. Nov 27 21:27:59.935734 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-af5b2f7f-f8db-421b-9296-6c044b7f2955 tempest-TestVolumeBackupRestore-900720088 None] Remove volume export completed successfully. Nov 27 21:28:00.606683 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:28:00.610546 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:28:00.611050 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:28:00.626867 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Flow 'volume_create_manager' (04d1fdc5-941f-46b2-8b20-9aa772b33f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:28:00.630164 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3055fb-867d-4a37-ad15-5a1fccb9df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.636369 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:28:00.649602 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3055fb-867d-4a37-ad15-5a1fccb9df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:28:00Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_6906a280-43f6-416c-9528-e316f4a00ceb',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b896c246-d90f-40d7-8c0c-b3d5febff035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34545818a5a9484a943ab6e09bdd800a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:28:01Z,use_quota=True,user_id='011c76eca940449f865a90106ed59c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.652843 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c267dc12-2129-413d-9179-7ae245194db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.655036 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c267dc12-2129-413d-9179-7ae245194db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.657498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49e2802-dc16-48a7-b0ec-af4a31896d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.659798 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49e2802-dc16-48a7-b0ec-af4a31896d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b896c246-d90f-40d7-8c0c-b3d5febff035', 'volume_name': 'volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.662130 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003c8e3d-2da4-4480-b60c-3fc90e993957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.664317 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003c8e3d-2da4-4480-b60c-3fc90e993957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.666555 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b428902e-926f-4c89-b31e-73c21a7a5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.667374 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Volume b896c246-d90f-40d7-8c0c-b3d5febff035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'volume_size': 1} Nov 27 21:28:00.667808 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] creating volume 'volume-b896c246-d90f-40d7-8c0c-b3d5febff035' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:28:00.668794 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:28:00.717085 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:28:00.717465 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:28:00.719687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b428902e-926f-4c89-b31e-73c21a7a5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.722547 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5890ca07-403f-41e2-972e-0f08c5c1885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:28:00.731670 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Volume volume-b896c246-d90f-40d7-8c0c-b3d5febff035 (b896c246-d90f-40d7-8c0c-b3d5febff035): created successfully Nov 27 21:28:00.733566 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5890ca07-403f-41e2-972e-0f08c5c1885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:28:00.736700 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Flow 'volume_create_manager' (04d1fdc5-941f-46b2-8b20-9aa772b33f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:28:00.744364 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Created volume successfully. Nov 27 21:28:01.690729 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:28:02.316817 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:28:02.317635 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'b896c246-d90f-40d7-8c0c-b3d5febff035', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:28:02.332646 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Initialize volume connection completed successfully. Nov 27 21:28:06.870987 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Terminate volume connection completed successfully. Nov 27 21:28:06.886445 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5136a9bc-b4f5-4896-8fe5-e06fcf0ee72b tempest-TestVolumeBackupRestore-900720088 None] Remove volume export completed successfully. Nov 27 21:28:10.937771 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd req-641a9482-5dc8-412e-a593-a3fb53481e1c tempest-TestVolumeBackupRestore-900720088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:28:11.613413 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd req-641a9482-5dc8-412e-a593-a3fb53481e1c tempest-TestVolumeBackupRestore-900720088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.675s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:28:11.614662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd req-641a9482-5dc8-412e-a593-a3fb53481e1c tempest-TestVolumeBackupRestore-900720088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'b896c246-d90f-40d7-8c0c-b3d5febff035', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:28:11.641142 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd req-641a9482-5dc8-412e-a593-a3fb53481e1c tempest-TestVolumeBackupRestore-900720088 None] Connection info returned from driver {'name': 'volumes/volume-b896c246-d90f-40d7-8c0c-b3d5febff035', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b896c246-d90f-40d7-8c0c-b3d5febff035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7f943a0-bb6b-4ca8-90e8-56be738bc6c8'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:28:11.689374 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd req-641a9482-5dc8-412e-a593-a3fb53481e1c tempest-TestVolumeBackupRestore-900720088 None] attachment_update completed successfully. Nov 27 21:28:57.926821 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:28:57.927836 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:28:57.954518 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:28:57.981353 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:29:08.542481 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-7395df6c-78ea-43fd-9e8d-976c1330284c req-5d65337d-4466-4f6f-828a-acba3c8d6600 tempest-TestVolumeBackupRestore-900720088 None] Terminate volume connection completed successfully. Nov 27 21:29:08.543159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-7395df6c-78ea-43fd-9e8d-976c1330284c req-5d65337d-4466-4f6f-828a-acba3c8d6600 tempest-TestVolumeBackupRestore-900720088 None] Deleting attachment a7f943a0-bb6b-4ca8-90e8-56be738bc6c8. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:29:10.012292 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-b896c246-d90f-40d7-8c0c-b3d5febff035-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:29:10.047455 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:10.616312 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Volume volume-b896c246-d90f-40d7-8c0c-b3d5febff035 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:29:10.641639 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] deleting rbd volume volume-b896c246-d90f-40d7-8c0c-b3d5febff035 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:29:10.659614 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-895f0bf1-7373-4777-9163-1d0dff41ae31-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:29:10.692779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:11.849288 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] deleting rbd volume volume-895f0bf1-7373-4777-9163-1d0dff41ae31 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:29:11.886183 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Created reservations ['d268ac28-8416-4d7f-9da1-34d0a7510f08', 'd702c059-edbf-4731-89fc-4a7cf76e1a24', '9e242cf4-e754-474a-bd0b-b1ff5316f48f', '6680ec44-45d0-4539-b9bd-a945fbbe95b7'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:29:11.929484 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:11.953698 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:11.981831 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:29:11.987064 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Deleted volume successfully. Nov 27 21:29:12.001026 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-eca4db64-704f-47d5-9a25-55581a24167a tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-b896c246-d90f-40d7-8c0c-b3d5febff035-delete_volume'" released by "delete_volume" :: held 1.989s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:29:12.032603 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:29:12.063722 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] deleting parent snapshot volume-895f0bf1-7373-4777-9163-1d0dff41ae31.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:29:12.907378 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] Created reservations ['1b5005aa-7f85-42ef-8601-f29ead2c81b2', '705cf7ab-c647-4588-b0a8-d40567fc1dad', 'f93cfff2-f6d4-4ec1-b0ab-3d174b2d0d1f', 'd288be80-8032-4774-95a6-b488e175d718'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:29:12.948655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:12.970090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:12.992123 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:29:12.996178 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] Deleted volume successfully. Nov 27 21:29:13.008740 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-edd131ea-52ec-4cac-b4bc-28ae96b4c97b tempest-TestVolumeBackupRestore-900720088 None] Lock "b'cinder-895f0bf1-7373-4777-9163-1d0dff41ae31-delete_volume'" released by "delete_volume" :: held 2.349s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:29:14.806955 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 req-ce1f5942-8ef2-4b7d-a209-b9d740978909 tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:29:14.807702 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 req-ce1f5942-8ef2-4b7d-a209-b9d740978909 tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment 3cfdf09c-e0f9-4c4f-ac97-fc7fdb7fd211. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:29:18.695093 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c req-5bcb46eb-7e6d-4781-922d-d40a68d1b127 tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:29:19.406862 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c req-5bcb46eb-7e6d-4781-922d-d40a68d1b127 tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.710s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:29:19.408073 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c req-5bcb46eb-7e6d-4781-922d-d40a68d1b127 tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '03079e0b-c8b5-4a98-beae-24c4370e0212', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:29:19.436610 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c req-5bcb46eb-7e6d-4781-922d-d40a68d1b127 tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-03079e0b-c8b5-4a98-beae-24c4370e0212', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03079e0b-c8b5-4a98-beae-24c4370e0212', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed4dbceb-f4c4-49c6-ad58-294fed41cf6f'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:29:19.513546 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c req-5bcb46eb-7e6d-4781-922d-d40a68d1b127 tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:29:57.927999 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:29:57.928892 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:57.951468 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:29:57.973467 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:30:57.929290 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:30:57.930030 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:30:57.951565 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:30:57.972478 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:31:11.791549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee3b968c-7922-4220-b972-9f0f89923d4d tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:31:12.735506 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee3b968c-7922-4220-b972-9f0f89923d4d tempest-TestVolumeBootPattern-1822676883 None] Create snapshot completed successfully Nov 27 21:31:13.162977 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:31:13.166733 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:31:13.167227 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:31:13.188598 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (839ecc75-f9d6-4133-9835-307aa1dde935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:31:13.192166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410a6ad5-d48c-49ab-8a0e-d3b9100cb11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.198858 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:31:13.210976 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410a6ad5-d48c-49ab-8a0e-d3b9100cb11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1751178721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1416292a-dba9-4a66-85b6-f0929de78ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d471b7fbc14bbcbf3dbb7f1acbddcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de0564b8-a79a-4e23-adc6-6207373cfacf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:31:13Z,use_quota=True,user_id='22d0ea2ed19044fa8d47565b0eb443d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.213577 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b27168-4548-4f4a-91c1-8be37768798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.215730 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b27168-4548-4f4a-91c1-8be37768798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.218110 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f660c49-b406-4074-a5f5-334b2e288d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.220326 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f660c49-b406-4074-a5f5-334b2e288d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1416292a-dba9-4a66-85b6-f0929de78ebf', 'volume_name': 'volume-1416292a-dba9-4a66-85b6-f0929de78ebf', 'volume_size': 1, 'snapshot_id': 'de0564b8-a79a-4e23-adc6-6207373cfacf'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.222620 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492157fd-94b9-4e72-aa20-b6d6b87de03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.224747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492157fd-94b9-4e72-aa20-b6d6b87de03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.226943 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c6a00a-8b9c-4ed3-bcac-02ce2e6f6984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.227749 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Volume 1416292a-dba9-4a66-85b6-f0929de78ebf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1416292a-dba9-4a66-85b6-f0929de78ebf', 'volume_size': 1, 'snapshot_id': 'de0564b8-a79a-4e23-adc6-6207373cfacf'} Nov 27 21:31:13.248440 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] cloning volumes/volume-03079e0b-c8b5-4a98-beae-24c4370e0212@snapshot-de0564b8-a79a-4e23-adc6-6207373cfacf to volume-1416292a-dba9-4a66-85b6-f0929de78ebf {{(pid=129088) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Nov 27 21:31:13.249366 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:31:13.307809 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:31:13.429912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:31:13.430222 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:31:13.449156 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Marking volume 1416292a-dba9-4a66-85b6-f0929de78ebf as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 21:31:13.453485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Copying metadata from snapshot de0564b8-a79a-4e23-adc6-6207373cfacf to 1416292a-dba9-4a66-85b6-f0929de78ebf. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 27 21:31:13.483633 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c6a00a-8b9c-4ed3-bcac-02ce2e6f6984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1416292a-dba9-4a66-85b6-f0929de78ebf', 'volume_size': 1, 'snapshot_id': 'de0564b8-a79a-4e23-adc6-6207373cfacf'}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.485883 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cd55fe-98fa-4a04-8331-4095849c83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:31:13.493963 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Volume volume-1416292a-dba9-4a66-85b6-f0929de78ebf (1416292a-dba9-4a66-85b6-f0929de78ebf): created successfully Nov 27 21:31:13.495854 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cd55fe-98fa-4a04-8331-4095849c83cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:31:13.499239 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Flow 'volume_create_manager' (839ecc75-f9d6-4133-9835-307aa1dde935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:31:13.510609 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ccbce104-8e37-48ee-a860-b3b23e1d90bb tempest-TestVolumeBootPattern-1822676883 None] Created volume successfully. Nov 27 21:31:16.503043 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-7e2ff465-803c-44cc-914d-d2552f38fe77 req-f5c4fcf1-9cd6-4770-aa83-719152440a49 tempest-TestVolumeBootPattern-1822676883 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:31:17.145860 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-7e2ff465-803c-44cc-914d-d2552f38fe77 req-f5c4fcf1-9cd6-4770-aa83-719152440a49 tempest-TestVolumeBootPattern-1822676883 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:31:17.146605 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-7e2ff465-803c-44cc-914d-d2552f38fe77 req-f5c4fcf1-9cd6-4770-aa83-719152440a49 tempest-TestVolumeBootPattern-1822676883 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1416292a-dba9-4a66-85b6-f0929de78ebf', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '1416292a-dba9-4a66-85b6-f0929de78ebf', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:31:17.171038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-7e2ff465-803c-44cc-914d-d2552f38fe77 req-f5c4fcf1-9cd6-4770-aa83-719152440a49 tempest-TestVolumeBootPattern-1822676883 None] Connection info returned from driver {'name': 'volumes/volume-1416292a-dba9-4a66-85b6-f0929de78ebf', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1416292a-dba9-4a66-85b6-f0929de78ebf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '777f2f5e-add7-450a-9fea-d7823307bd2d'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:31:17.218787 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-7e2ff465-803c-44cc-914d-d2552f38fe77 req-f5c4fcf1-9cd6-4770-aa83-719152440a49 tempest-TestVolumeBootPattern-1822676883 None] attachment_update completed successfully. Nov 27 21:31:57.927782 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:31:57.928787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:31:57.952208 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:31:57.975161 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:32:57.930448 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:32:57.931136 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:32:57.952251 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:32:57.979655 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:33:23.252299 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-8ffe2211-081c-4876-84a5-cf71604fd124 req-a91ff1af-3623-4ac2-b978-1250f5797537 tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:33:23.252932 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-8ffe2211-081c-4876-84a5-cf71604fd124 req-a91ff1af-3623-4ac2-b978-1250f5797537 tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment 777f2f5e-add7-450a-9fea-d7823307bd2d. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:33:24.469987 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-1416292a-dba9-4a66-85b6-f0929de78ebf-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:33:24.500749 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:24.576105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:33:24.583909 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-1416292a-dba9-4a66-85b6-f0929de78ebf {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:33:24.824763 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['7a0515f8-e12c-4acc-84fe-961ce77c0547', '27f8d55b-dd5d-4b66-8d89-76508af5b64c', '59db3ddd-9e39-4500-bfc7-a5937d621538', 'abdb9db1-5abd-4e2f-a48e-22de85200555'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:33:24.865902 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:24.889691 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:24.912276 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:33:24.916441 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:33:24.928301 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-c790e2cf-a905-4347-845b-33e951aa73be tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-1416292a-dba9-4a66-85b6-f0929de78ebf-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:33:25.583483 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ee804d6f-0e4b-4a59-9363-862eaad04483 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-de0564b8-a79a-4e23-adc6-6207373cfacf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:33:25.585157 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-ee804d6f-0e4b-4a59-9363-862eaad04483 tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:55.746815 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-ee804d6f-0e4b-4a59-9363-862eaad04483 tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['d044356c-653e-4862-8d00-f2231b744959', 'ee45f7d2-7ab0-4eec-8774-a103292b8c76', 'eb2b6847-9098-47f1-a851-6e805123ebdf', '784de388-6795-4360-a383-16d9e6c66ace'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:33:55.783471 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-ee804d6f-0e4b-4a59-9363-862eaad04483 tempest-TestVolumeBootPattern-1822676883 None] Delete snapshot completed successfully. Nov 27 21:33:55.788105 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-ee804d6f-0e4b-4a59-9363-862eaad04483 tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-de0564b8-a79a-4e23-adc6-6207373cfacf-delete_snapshot'" released by "delete_snapshot" :: held 30.205s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:33:57.935164 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:33:57.936238 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:57.958242 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:33:57.990318 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:33:59.492347 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-b0382c9b-bb62-427c-806e-d078f5c985de req-0a6ee61f-1441-44ff-9120-374341ebca17 tempest-TestVolumeBootPattern-1822676883 None] Terminate volume connection completed successfully. Nov 27 21:33:59.492956 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-b0382c9b-bb62-427c-806e-d078f5c985de req-0a6ee61f-1441-44ff-9120-374341ebca17 tempest-TestVolumeBootPattern-1822676883 None] Deleting attachment ed4dbceb-f4c4-49c6-ad58-294fed41cf6f. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:34:01.408166 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-03079e0b-c8b5-4a98-beae-24c4370e0212-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:34:01.447448 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:34:01.510735 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:34:01.517434 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] deleting rbd volume volume-03079e0b-c8b5-4a98-beae-24c4370e0212 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:34:01.755711 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 21:34:01.786686 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] deleting parent snapshot volume-03079e0b-c8b5-4a98-beae-24c4370e0212.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 21:34:02.744148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] Created reservations ['e61f0cf4-bea7-4530-8d70-f4c123613c30', '999188aa-331e-4dfb-8d1d-67b832f43eaf', '8e5d79b3-fcff-4424-a38e-e2588d786431', 'aa2c48ec-e815-487f-8651-09d9fa073e19'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:34:02.787753 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:34:02.810090 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:34:02.832779 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:34:02.837551 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] Deleted volume successfully. Nov 27 21:34:02.849236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-83c8d627-4a3b-40f7-b5b0-92945cdf153c tempest-TestVolumeBootPattern-1822676883 None] Lock "b'cinder-03079e0b-c8b5-4a98-beae-24c4370e0212-delete_volume'" released by "delete_volume" :: held 1.441s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:34:57.935989 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:34:57.936685 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:34:57.957646 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:34:57.982148 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:35:57.936603 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:35:57.937302 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:35:57.959948 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:35:57.983806 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:36:57.938628 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:36:57.940181 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:36:57.974236 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:36:58.018832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:37:57.936407 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:37:57.937058 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:37:57.958894 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:37:57.985832 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:38:57.941148 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:38:57.942192 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:38:57.963438 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:38:57.984829 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:39:57.940038 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:39:57.940725 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:39:57.962004 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:39:57.983534 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:40:57.938955 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:40:57.939688 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:40:57.960911 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:40:57.982535 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:41:57.937779 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:41:57.938477 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:41:57.959543 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:41:57.980889 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:42:57.937356 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:42:57.938018 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:42:57.959223 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:42:57.980914 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:43:57.935908 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:43:57.936592 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:43:57.958246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:43:57.979571 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:45:57.935106 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:45:57.936254 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:45:57.991397 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:45:58.028599 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:46:57.935554 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:46:57.936209 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:46:57.957533 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:46:57.979364 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:47:57.934599 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:47:57.935239 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:47:57.957019 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:47:57.977701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:48:35.944509 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:48:35.948030 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:48:35.948521 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:48:35.961071 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Flow 'volume_create_manager' (8211997d-8561-4f6d-a495-39f895786649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:48:35.964371 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6111bb4e-dd70-429f-a9bb-73bf32e58501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:35.971508 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:48:35.984079 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6111bb4e-dd70-429f-a9bb-73bf32e58501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-876698617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed512092-9da9-4d3d-b19b-33dad77c3f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac362e2c70a4862919a7dfcd5f32167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:48:36Z,use_quota=True,user_id='df0509ba3bea4d9f893f5c966b9efd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:35.986636 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bb4415-2eef-4240-aeaf-42e15ffb0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:35.988801 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bb4415-2eef-4240-aeaf-42e15ffb0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:35.991186 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af883c5-9fc2-4bb4-a349-4de6694f985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:35.993423 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af883c5-9fc2-4bb4-a349-4de6694f985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'volume_name': 'volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:35.995747 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba05659b-7e3c-4b32-89ff-965dc926621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:35.997847 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba05659b-7e3c-4b32-89ff-965dc926621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:36.000741 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18acfc7b-9b2b-4cde-912f-5dae972cb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:36.001522 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Volume ed512092-9da9-4d3d-b19b-33dad77c3f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'volume_size': 1} Nov 27 21:48:36.001923 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] creating volume 'volume-ed512092-9da9-4d3d-b19b-33dad77c3f26' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:48:36.002876 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:48:36.050775 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:48:36.051080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:48:36.053113 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18acfc7b-9b2b-4cde-912f-5dae972cb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:36.055372 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140802ec-cf96-4bb0-ac99-f9ab1a1d16d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:48:36.064706 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Volume volume-ed512092-9da9-4d3d-b19b-33dad77c3f26 (ed512092-9da9-4d3d-b19b-33dad77c3f26): created successfully Nov 27 21:48:36.066693 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140802ec-cf96-4bb0-ac99-f9ab1a1d16d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:48:36.070080 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Flow 'volume_create_manager' (8211997d-8561-4f6d-a495-39f895786649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:48:36.077433 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-1c2a7910-5dde-4c79-b29c-28ec4b0ef3b0 tempest-ServerActionsTestJSON-439351180 None] Created volume successfully. Nov 27 21:48:37.530112 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0dde2f13-b187-4849-808a-4bfbd524c07a req-d46322aa-c17c-49a3-a163-0dbf62640ad8 tempest-ServerActionsTestJSON-439351180 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:48:38.161877 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-0dde2f13-b187-4849-808a-4bfbd524c07a req-d46322aa-c17c-49a3-a163-0dbf62640ad8 tempest-ServerActionsTestJSON-439351180 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:48:38.162608 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-0dde2f13-b187-4849-808a-4bfbd524c07a req-d46322aa-c17c-49a3-a163-0dbf62640ad8 tempest-ServerActionsTestJSON-439351180 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:48:38.189067 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0dde2f13-b187-4849-808a-4bfbd524c07a req-d46322aa-c17c-49a3-a163-0dbf62640ad8 tempest-ServerActionsTestJSON-439351180 None] Connection info returned from driver {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47fcc63f-079a-4dfb-b798-d5455d0a75cf'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:48:38.258016 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-0dde2f13-b187-4849-808a-4bfbd524c07a req-d46322aa-c17c-49a3-a163-0dbf62640ad8 tempest-ServerActionsTestJSON-439351180 None] attachment_update completed successfully. Nov 27 21:48:56.068935 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-20c4e96a-e879-4519-90e8-948f5d55c677 tempest-ServerActionsTestJSON-439351180 None] Terminate volume connection completed successfully. Nov 27 21:48:56.069912 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-20c4e96a-e879-4519-90e8-948f5d55c677 tempest-ServerActionsTestJSON-439351180 None] Deleting attachment 47fcc63f-079a-4dfb-b798-d5455d0a75cf. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:48:57.935388 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:48:57.936329 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:48:57.958990 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:48:57.981348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:48:57.992960 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-97105966-d4cb-4dc7-b743-b07186523df3 tempest-ServerActionsTestJSON-439351180 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:48:58.626409 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-97105966-d4cb-4dc7-b743-b07186523df3 tempest-ServerActionsTestJSON-439351180 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.633s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:48:58.627215 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-97105966-d4cb-4dc7-b743-b07186523df3 tempest-ServerActionsTestJSON-439351180 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:48:58.649114 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-97105966-d4cb-4dc7-b743-b07186523df3 tempest-ServerActionsTestJSON-439351180 None] Connection info returned from driver {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94b0bdd4-6968-4b12-8916-0313080cb6b8'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:48:58.696106 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d req-97105966-d4cb-4dc7-b743-b07186523df3 tempest-ServerActionsTestJSON-439351180 None] attachment_update completed successfully. Nov 27 21:49:05.853791 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-4e8763b1-4aa8-430c-a97c-8e6d7db63cf2 tempest-ServerActionsTestJSON-439351180 None] Terminate volume connection completed successfully. Nov 27 21:49:05.854475 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-4e8763b1-4aa8-430c-a97c-8e6d7db63cf2 tempest-ServerActionsTestJSON-439351180 None] Deleting attachment 94b0bdd4-6968-4b12-8916-0313080cb6b8. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:49:08.245358 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-913e980d-d19d-478d-9b94-458212afc10e tempest-ServerActionsTestJSON-439351180 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:49:08.887731 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-913e980d-d19d-478d-9b94-458212afc10e tempest-ServerActionsTestJSON-439351180 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:49:08.888567 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-913e980d-d19d-478d-9b94-458212afc10e tempest-ServerActionsTestJSON-439351180 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:49:08.909926 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-913e980d-d19d-478d-9b94-458212afc10e tempest-ServerActionsTestJSON-439351180 None] Connection info returned from driver {'name': 'volumes/volume-ed512092-9da9-4d3d-b19b-33dad77c3f26', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ed512092-9da9-4d3d-b19b-33dad77c3f26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '16bcf666-9165-4597-8aaf-e7308da32a34'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:49:08.958020 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 req-913e980d-d19d-478d-9b94-458212afc10e tempest-ServerActionsTestJSON-439351180 None] attachment_update completed successfully. Nov 27 21:49:16.431582 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-0e54513a-37c0-4100-9178-218f9f9a4ade req-0fe0e356-5108-4296-b33a-16cc581135df tempest-ServerActionsTestJSON-439351180 None] Terminate volume connection completed successfully. Nov 27 21:49:16.432246 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-0e54513a-37c0-4100-9178-218f9f9a4ade req-0fe0e356-5108-4296-b33a-16cc581135df tempest-ServerActionsTestJSON-439351180 None] Deleting attachment 16bcf666-9165-4597-8aaf-e7308da32a34. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:49:17.231770 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Lock "b'cinder-ed512092-9da9-4d3d-b19b-33dad77c3f26-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:49:17.266687 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:49:17.314107 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:49:17.314654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Volume volume-ed512092-9da9-4d3d-b19b-33dad77c3f26 is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:49:17.322417 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] deleting rbd volume volume-ed512092-9da9-4d3d-b19b-33dad77c3f26 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:49:17.543413 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Created reservations ['e0b91e2c-d08e-42d9-b650-27251ebe1c32', 'a95a87cd-36d0-422d-a465-2141965eabf6', '8317bed6-e8cd-4996-8ded-cc45e455b6e8', 'c15604ec-7441-4d44-baf6-90569ac131c5'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:49:17.583533 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:49:17.605264 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:49:17.629325 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:49:17.633496 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Deleted volume successfully. Nov 27 21:49:17.645075 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-dadb4fcb-76a6-423c-951d-f6448226dca4 tempest-ServerActionsTestJSON-439351180 None] Lock "b'cinder-ed512092-9da9-4d3d-b19b-33dad77c3f26-delete_volume'" released by "delete_volume" :: held 0.413s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:49:57.941483 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:49:57.942556 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:49:57.966979 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:49:57.989408 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:50:55.277746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 21:50:55.282362 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 21:50:55.282854 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 21:50:55.300798 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Flow 'volume_create_manager' (d4c062d9-4b95-4bd3-9ce8-438d275ff263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:50:55.304254 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55efc50d-66ea-47e6-8588-5780a74a459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.314741 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 21:50:55.325126 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55efc50d-66ea-47e6-8588-5780a74a459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T21:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1144841830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9207a48d-29e4-4cd6-820f-811f7049dcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741fb423d7b24833be8f3d9d7d83294e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T21:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T21:50:55Z,use_quota=True,user_id='a32b19324e154c7fb5e29e374753ba7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.327707 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ccad-9c0c-4fa7-b32e-026c2bae79d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.330493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07ccad-9c0c-4fa7-b32e-026c2bae79d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.332918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f907c70-d1ac-462f-9a26-605441c16640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.335235 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f907c70-d1ac-462f-9a26-605441c16640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9207a48d-29e4-4cd6-820f-811f7049dcef', 'volume_name': 'volume-9207a48d-29e4-4cd6-820f-811f7049dcef', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.338050 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4044bc-75e6-4d65-924c-e98f6679e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.340175 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4044bc-75e6-4d65-924c-e98f6679e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.342348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde93f4d-b783-4838-8716-bc8797b5ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.343129 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Volume 9207a48d-29e4-4cd6-820f-811f7049dcef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9207a48d-29e4-4cd6-820f-811f7049dcef', 'volume_size': 1} Nov 27 21:50:55.343549 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] creating volume 'volume-9207a48d-29e4-4cd6-820f-811f7049dcef' {{(pid=129088) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Nov 27 21:50:55.345056 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:50:55.394515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 21:50:55.394916 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 21:50:55.397009 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde93f4d-b783-4838-8716-bc8797b5ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9207a48d-29e4-4cd6-820f-811f7049dcef', 'volume_size': 1}' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.399260 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11539454-5e9f-4c6f-a7f3-057c3b18299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 21:50:55.408417 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Volume volume-9207a48d-29e4-4cd6-820f-811f7049dcef (9207a48d-29e4-4cd6-820f-811f7049dcef): created successfully Nov 27 21:50:55.410337 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11539454-5e9f-4c6f-a7f3-057c3b18299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 21:50:55.413292 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Flow 'volume_create_manager' (d4c062d9-4b95-4bd3-9ce8-438d275ff263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 21:50:55.420338 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5588a6ad-b313-4d6a-a342-3e9e37d89d73 tempest-TestMinimumBasicScenario-1311005881 None] Created volume successfully. Nov 27 21:50:56.815721 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-665c849f-dbdd-42d5-a897-4de7cfad6c6a req-d93ed770-6379-4d3e-8735-2b35fbe54c31 tempest-TestMinimumBasicScenario-1311005881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 21:50:57.526972 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-665c849f-dbdd-42d5-a897-4de7cfad6c6a req-d93ed770-6379-4d3e-8735-2b35fbe54c31 tempest-TestMinimumBasicScenario-1311005881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.711s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 21:50:57.527839 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-665c849f-dbdd-42d5-a897-4de7cfad6c6a req-d93ed770-6379-4d3e-8735-2b35fbe54c31 tempest-TestMinimumBasicScenario-1311005881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9207a48d-29e4-4cd6-820f-811f7049dcef', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '9207a48d-29e4-4cd6-820f-811f7049dcef', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 21:50:57.550504 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-665c849f-dbdd-42d5-a897-4de7cfad6c6a req-d93ed770-6379-4d3e-8735-2b35fbe54c31 tempest-TestMinimumBasicScenario-1311005881 None] Connection info returned from driver {'name': 'volumes/volume-9207a48d-29e4-4cd6-820f-811f7049dcef', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9207a48d-29e4-4cd6-820f-811f7049dcef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6b99dd4-5ec1-4d84-8acf-a514dcc631b5'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 21:50:57.594488 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-665c849f-dbdd-42d5-a897-4de7cfad6c6a req-d93ed770-6379-4d3e-8735-2b35fbe54c31 tempest-TestMinimumBasicScenario-1311005881 None] attachment_update completed successfully. Nov 27 21:50:57.944224 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:50:57.945264 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:50:57.969892 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:50:57.992771 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:51:57.948069 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:51:57.948796 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:51:57.970134 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:51:57.994447 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:52:57.948869 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:52:57.949652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:52:57.971313 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:52:57.993038 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:53:18.787305 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-13daa70a-0d96-49dd-be52-0ebb17724747 req-07390a93-5615-413a-bfec-b9bcc0412603 tempest-TestMinimumBasicScenario-1311005881 None] Terminate volume connection completed successfully. Nov 27 21:53:18.787923 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-13daa70a-0d96-49dd-be52-0ebb17724747 req-07390a93-5615-413a-bfec-b9bcc0412603 tempest-TestMinimumBasicScenario-1311005881 None] Deleting attachment f6b99dd4-5ec1-4d84-8acf-a514dcc631b5. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 21:53:19.366078 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Lock "b'cinder-9207a48d-29e4-4cd6-820f-811f7049dcef-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 21:53:19.394799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:53:19.439147 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 21:53:19.439636 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Volume volume-9207a48d-29e4-4cd6-820f-811f7049dcef is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 21:53:19.447976 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] deleting rbd volume volume-9207a48d-29e4-4cd6-820f-811f7049dcef {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 21:53:19.647050 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Created reservations ['799dae70-d77a-4a2b-b007-93c4ee03e222', '1466fb56-a592-47d7-8570-dfbc909920fe', 'faa16e8d-6269-46f6-9022-2e0ac708fb4c', 'edda751e-6a8a-4f82-bd0f-9f141f69b614'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 21:53:19.684387 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:53:19.706746 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:53:19.728285 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:53:19.732391 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Deleted volume successfully. Nov 27 21:53:19.744373 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-634899df-8d13-4337-aecd-2bbb9d08960d tempest-TestMinimumBasicScenario-1311005881 None] Lock "b'cinder-9207a48d-29e4-4cd6-820f-811f7049dcef-delete_volume'" released by "delete_volume" :: held 0.380s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 21:53:57.947814 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:53:57.948538 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:53:57.969974 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:53:57.992118 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:54:57.946729 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:54:57.947461 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:54:57.968180 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:54:57.989600 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:55:57.944549 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:55:57.945258 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:55:57.972654 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:55:57.993641 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:56:57.948782 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:56:57.949498 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:56:57.970110 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:56:57.992508 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:57:57.946886 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:57:57.947596 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:57:57.976043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:57:57.998652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:58:57.943981 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:58:57.944690 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:58:57.966515 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:58:57.987063 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 21:59:57.942264 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 21:59:57.942968 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:59:57.964591 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 21:59:57.986432 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:00:57.941869 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:00:57.942572 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:00:57.964813 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:00:57.985688 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:01:57.941639 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:01:57.942340 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:01:57.963562 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:01:57.984426 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:02:57.938829 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:02:57.939585 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:02:57.960931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:02:57.981936 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:03:57.937173 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:03:57.937948 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:03:57.962446 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:03:57.986650 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:04:57.942198 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:04:57.942885 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:04:57.964787 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:04:57.987348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:05:57.942423 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:05:57.943092 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:05:57.964431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:05:57.986018 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:06:57.941204 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:06:57.941863 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:06:57.964796 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:06:57.986479 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:07:57.941672 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:07:57.942382 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:07:57.963530 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:07:57.985529 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:08:57.941256 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:08:57.942091 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:08:57.965765 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:08:57.986743 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:09:43.803083 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129088) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 27 22:09:43.806727 ncdv-master-1 cinder-volume[129088]: WARNING stevedore.named [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 27 22:09:43.807210 ncdv-master-1 cinder-volume[129088]: WARNING castellan.key_manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 27 22:09:43.819955 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Flow 'volume_create_manager' (43b3dc17-871a-4d1a-b0fe-7d84a5b2c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 22:09:43.823187 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14740b5b-bea5-41f5-970c-630eb2b78cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:43.830253 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_db.sqlalchemy.engines [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 22:09:43.844701 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14740b5b-bea5-41f5-970c-630eb2b78cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-27T22:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2014532054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=29b72438-124b-49c5-9fb2-cde91536dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2673f0e267164ddc9371d10cb58d17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-27T22:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-27T22:09:44Z,use_quota=True,user_id='1ca9642dc2294528a287553029ab7c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(425f3ffd-b3de-492e-b90b-364a8317bba9),volume_type_id=425f3ffd-b3de-492e-b90b-364a8317bba9)' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:43.847783 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3a2724-85c5-4d00-849a-92de5855da98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:43.849931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3a2724-85c5-4d00-849a-92de5855da98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:43.852348 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2ae4e7-085a-4d18-a3d4-21e761530139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:43.929085 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2ae4e7-085a-4d18-a3d4-21e761530139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29b72438-124b-49c5-9fb2-cde91536dbe6', 'volume_name': 'volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:43.931570 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffd668e-b65c-49e7-a857-3c7426d564f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:43.933939 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffd668e-b65c-49e7-a857-3c7426d564f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:43.936279 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5466d89-e4c5-44df-a638-87aa2272fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:43.937127 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Volume 29b72438-124b-49c5-9fb2-cde91536dbe6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 27 22:09:43.937709 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Cloning 29b72438-124b-49c5-9fb2-cde91536dbe6 from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 at location (None, None). {{(pid=129088) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 27 22:09:43.947019 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 22:09:43.956951 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 22, 9, 43, 951478)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 22:09:43.957393 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 22:09:43.957798 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Found cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 27 22:09:43.961871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Lock "b'cinder-dad06d36-e5fe-4577-8da6-2101ffe62bc8'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 22:09:43.962768 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Attempting to retrieve cache entry for image = dad06d36-e5fe-4577-8da6-2101ffe62bc8 on host ncdv-master-1@ceph#ceph. {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 27 22:09:43.967896 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Found image-volume cache entry: {'id': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'volume_id': '433fd822-ffe5-4ab5-8263-5d965af3008e', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23), 'last_used': datetime.datetime(2021, 11, 27, 22, 9, 43, 965783)}. {{(pid=129088) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 27 22:09:43.968314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.image.cache [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Image-volume cache entry image_update_at = 2021-11-27 20:37:23+00:00, requested image updated_at = 2021-11-27 20:37:23+00:00. {{(pid=129088) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 27 22:09:43.968708 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Creating from source image-volume 433fd822-ffe5-4ab5-8263-5d965af3008e {{(pid=129088) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 27 22:09:43.981326 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:09:44.032279 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] creating snapshot='volume-29b72438-124b-49c5-9fb2-cde91536dbe6.clone_snap' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Nov 27 22:09:44.110159 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] cloning 'volume-433fd822-ffe5-4ab5-8263-5d965af3008e@volume-29b72438-124b-49c5-9fb2-cde91536dbe6.clone_snap' to 'volume-29b72438-124b-49c5-9fb2-cde91536dbe6' {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Nov 27 22:09:44.233542 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Volume volume-96fb951e-cc34-4858-9c6f-c24a0ea53a71.deleted is not a clone. {{(pid=129088) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Nov 27 22:09:44.234573 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Nov 27 22:09:44.234957 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129088) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Nov 27 22:09:44.251593 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] clone created successfully {{(pid=129088) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Nov 27 22:09:44.252213 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.volume_utils [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Marking volume 29b72438-124b-49c5-9fb2-cde91536dbe6 as bootable. {{(pid=129088) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 27 22:09:44.260145 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Copying metadata from image dad06d36-e5fe-4577-8da6-2101ffe62bc8 to 29b72438-124b-49c5-9fb2-cde91536dbe6. {{(pid=129088) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 27 22:09:44.260580 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Creating volume glance metadata for volume 29b72438-124b-49c5-9fb2-cde91536dbe6 backed by image dad06d36-e5fe-4577-8da6-2101ffe62bc8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129088) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 27 22:09:44.308931 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5466d89-e4c5-44df-a638-87aa2272fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'volume_size': 1, 'image_id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb5d1bf085ae456f8f7285f5a202640b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'dad06d36-e5fe-4577-8da6-2101ffe62bc8', 'created_at': datetime.datetime(2021, 11, 27, 20, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 27, 20, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:44.311094 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86f4b8e-cc5c-4903-900d-7e402148de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 27 22:09:44.325120 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.flows.manager.create_volume [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Volume volume-29b72438-124b-49c5-9fb2-cde91536dbe6 (29b72438-124b-49c5-9fb2-cde91536dbe6): created successfully Nov 27 22:09:44.327079 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86f4b8e-cc5c-4903-900d-7e402148de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129088) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 27 22:09:44.330198 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Flow 'volume_create_manager' (43b3dc17-871a-4d1a-b0fe-7d84a5b2c123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129088) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 27 22:09:44.338766 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [None req-5d0195dc-5cfe-4075-8cd7-16d7ce257498 tempest-TestShelveInstance-168226204 None] Created volume successfully. Nov 27 22:09:50.711056 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a req-151ec2ce-5454-4d8a-9e1e-d5ee88b9abce tempest-TestShelveInstance-168226204 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 22:09:51.375604 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a req-151ec2ce-5454-4d8a-9e1e-d5ee88b9abce tempest-TestShelveInstance-168226204 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.664s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 22:09:51.376413 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a req-151ec2ce-5454-4d8a-9e1e-d5ee88b9abce tempest-TestShelveInstance-168226204 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '29b72438-124b-49c5-9fb2-cde91536dbe6', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 22:09:51.398717 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a req-151ec2ce-5454-4d8a-9e1e-d5ee88b9abce tempest-TestShelveInstance-168226204 None] Connection info returned from driver {'name': 'volumes/volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '29b72438-124b-49c5-9fb2-cde91536dbe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd8eddfcf-f112-4f64-b87d-b260df31f3a1'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 22:09:51.448519 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a req-151ec2ce-5454-4d8a-9e1e-d5ee88b9abce tempest-TestShelveInstance-168226204 None] attachment_update completed successfully. Nov 27 22:09:57.942429 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:09:57.943221 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:09:57.982918 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:09:58.014921 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:10:57.941203 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:10:57.941871 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:10:57.962997 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:10:57.985137 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:11:57.941866 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:11:57.942532 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:11:57.963799 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:11:57.985505 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:12:21.073932 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-edb490b9-59ab-4fee-9486-49704b66fef9 req-50745dcf-fd01-47e0-9d41-53422e4df90a tempest-TestShelveInstance-168226204 None] Terminate volume connection completed successfully. Nov 27 22:12:21.074607 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-edb490b9-59ab-4fee-9486-49704b66fef9 req-50745dcf-fd01-47e0-9d41-53422e4df90a tempest-TestShelveInstance-168226204 None] Deleting attachment d8eddfcf-f112-4f64-b87d-b260df31f3a1. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 22:12:22.758242 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 req-2e7f1bec-baf4-41b4-85ef-cf9731e73682 tempest-TestShelveInstance-168226204 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 22:12:23.400921 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_concurrency.processutils [req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 req-2e7f1bec-baf4-41b4-85ef-cf9731e73682 tempest-TestShelveInstance-168226204 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=129088) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 22:12:23.401770 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 req-2e7f1bec-baf4-41b4-85ef-cf9731e73682 tempest-TestShelveInstance-168226204 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3c2f8537-22d4-4a83-aaae-7c3c3923127c', 'volume_id': '29b72438-124b-49c5-9fb2-cde91536dbe6', 'discard': True}} {{(pid=129088) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Nov 27 22:12:23.428886 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 req-2e7f1bec-baf4-41b4-85ef-cf9731e73682 tempest-TestShelveInstance-168226204 None] Connection info returned from driver {'name': 'volumes/volume-29b72438-124b-49c5-9fb2-cde91536dbe6', 'hosts': ['10.222.0.21'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '29b72438-124b-49c5-9fb2-cde91536dbe6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '14606dfc-4eb1-4528-8eff-17855e5923cf'} {{(pid=129088) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Nov 27 22:12:23.475327 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 req-2e7f1bec-baf4-41b4-85ef-cf9731e73682 tempest-TestShelveInstance-168226204 None] attachment_update completed successfully. Nov 27 22:12:57.941228 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:12:57.942112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:12:57.965529 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:12:57.987691 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:13:57.943161 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:13:57.943900 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:13:57.964681 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:13:57.985835 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:14:02.089852 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-a9c33be1-e8f9-4b6f-bd1a-6807193acaa5 tempest-TestShelveInstance-168226204 None] Terminate volume connection completed successfully. Nov 27 22:14:02.090493 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.manager [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-a9c33be1-e8f9-4b6f-bd1a-6807193acaa5 tempest-TestShelveInstance-168226204 None] Deleting attachment 14606dfc-4eb1-4528-8eff-17855e5923cf. {{(pid=129088) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Nov 27 22:14:02.219449 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] Lock "b'cinder-29b72438-124b-49c5-9fb2-cde91536dbe6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 27 22:14:02.250757 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:14:02.331200 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] volume has no backup snaps {{(pid=129088) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Nov 27 22:14:02.339380 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] deleting rbd volume volume-29b72438-124b-49c5-9fb2-cde91536dbe6 {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Nov 27 22:14:02.576662 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] volume is a clone so cleaning references {{(pid=129088) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Nov 27 22:14:02.611595 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] deleting parent snapshot volume-29b72438-124b-49c5-9fb2-cde91536dbe6.clone_snap {{(pid=129088) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Nov 27 22:14:02.975652 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.quota [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] Created reservations ['d9695fc2-d7a9-4494-a840-93301840465d', '0c06710e-5353-447a-a614-4ff67778f0f1', '652a8e81-e138-40d8-8635-bbb8926bb00e', '01b5a6d1-a853-4f3b-bbb3-41494619aa32'] {{(pid=129088) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 27 22:14:03.017408 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:14:03.040485 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:14:03.062972 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:14:03.067323 ncdv-master-1 cinder-volume[129088]: INFO cinder.volume.manager [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] Deleted volume successfully. Nov 27 22:14:03.078212 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.coordination [req-297cc5a6-59e1-4352-a3e2-a68e00b0081f req-9f7df525-5781-4f86-ae6d-81ecac558c9d tempest-TestShelveInstance-168226204 None] Lock "b'cinder-29b72438-124b-49c5-9fb2-cde91536dbe6-delete_volume'" released by "delete_volume" :: held 0.859s {{(pid=129088) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 27 22:14:57.941450 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:14:57.942112 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:14:57.969024 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:14:57.991546 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:15:57.946673 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:15:57.947964 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:15:57.969993 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:15:57.993330 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:16:57.948943 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:16:57.949607 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:16:57.971369 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:16:57.994742 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:17:57.950847 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:17:57.951587 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:17:57.975346 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:17:58.002713 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:18:57.948255 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:18:57.948982 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:18:57.971043 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:18:57.991869 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:19:57.946789 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:19:57.947544 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:19:57.969450 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:19:57.994431 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:20:57.949459 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:20:57.950139 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:20:57.971371 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:20:57.993294 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:21:57.948226 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:21:57.948904 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:21:57.970399 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:21:57.991507 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:22:57.946566 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:22:57.947314 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:22:57.968645 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:22:57.989880 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:23:57.947926 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:23:57.948612 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:23:57.970773 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:23:57.991476 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:24:57.947913 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:24:57.948576 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:24:57.969921 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:24:57.991718 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:25:57.948678 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:25:57.949462 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:25:57.972033 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:25:57.993724 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:26:57.948190 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:26:57.948859 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:26:57.970064 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:26:57.990941 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 27 22:27:57.946509 ncdv-master-1 cinder-volume[129088]: DEBUG oslo_service.periodic_task [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129088) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 27 22:27:57.947211 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:27:57.968558 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.volume.drivers.rbd [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129088) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Nov 27 22:27:57.990044 ncdv-master-1 cinder-volume[129088]: DEBUG cinder.manager [None req-a3ca35ab-402f-4ac8-9f8d-65a4db9bfa61 None None] Notifying Schedulers of capabilities ... {{(pid=129088) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}