-- Logs begin at Sat 2022-03-26 20:01:24 UTC, end at Sat 2022-03-26 22:09:12 UTC. -- Mar 26 20:40:05.218282 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Mar 26 20:40:08.622580 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:40:08.623165 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:40:09.021941 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_db.sqlalchemy.engines [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:40:09.327754 ncdv-master-1 cinder-volume[134669]: INFO cinder.rpc [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Mar 26 20:40:09.332247 ncdv-master-1 cinder-volume[134669]: INFO cinder.rpc [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Mar 26 20:40:09.339354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_db.sqlalchemy.engines [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:40:09.407195 ncdv-master-1 cinder-volume[134669]: INFO cinder.volume.manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Determined volume DB was empty at startup. Mar 26 20:40:09.407798 ncdv-master-1 cinder-volume[134669]: DEBUG cinder.volume.manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134669) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} Mar 26 20:40:09.415474 ncdv-master-1 cinder-volume[134669]: INFO cinder.volume.manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Service not found for updating active_backend_id, assuming default for driver init. Mar 26 20:40:09.416269 ncdv-master-1 cinder-volume[134669]: WARNING stevedore.named [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 26 20:40:09.417109 ncdv-master-1 cinder-volume[134669]: WARNING castellan.key_manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 26 20:40:09.418224 ncdv-master-1 cinder-volume[134669]: WARNING cinder.keymgr.conf_key_mgr [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 26 20:40:09.435860 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_db.sqlalchemy.engines [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:40:09.440180 ncdv-master-1 cinder-volume[134669]: INFO cinder.rpc [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Mar 26 20:40:09.444111 ncdv-master-1 cinder-volume[134669]: INFO cinder.rpc [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Mar 26 20:40:09.444867 ncdv-master-1 cinder-volume[134669]: WARNING stevedore.named [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Mar 26 20:40:09.445266 ncdv-master-1 cinder-volume[134669]: WARNING castellan.key_manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Mar 26 20:40:09.446913 ncdv-master-1 cinder-volume[134669]: INFO cinder.volume.manager [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Mar 26 20:40:09.453414 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_db.sqlalchemy.engines [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:40:09.470249 ncdv-master-1 cinder-volume[134669]: INFO oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Starting 1 workers Mar 26 20:40:09.475383 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Started child 134842 {{(pid=134669) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Mar 26 20:40:09.476511 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Full set of CONF: {{(pid=134669) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Mar 26 20:40:09.476892 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ******************************************************************************** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:40:09.477199 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] Configuration options gathered from: {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:40:09.477563 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:40:09.478219 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:40:09.478511 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ================================================================================ {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:40:09.479293 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] allow_availability_zone_fallback = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.479679 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] allow_compression_on_image_upload = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.480230 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] allowed_direct_url_schemes = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.480634 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] api_rate_limit = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.481129 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] auth_strategy = keystone {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.481560 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] az_cache_duration = 3600 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.481944 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_availability_zone = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.482349 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_host = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.482757 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.483145 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_stats_polling_interval = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.483519 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backup_api_class = cinder.backup.api.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.483876 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.484293 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backup_name_template = backup-%s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.484874 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backup_use_same_host = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.485224 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backup_use_temp_snapshot = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.485595 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] chap_password = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.485947 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] chap_username = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.486498 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.487121 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_internal_tenant_project_id = 5d311a58db4c44ebbd88fbdf463fab47 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.487670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_internal_tenant_user_id = 416ac158078b4b678c236e0ad811acad {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.488036 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cloned_volume_same_az = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.488407 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cluster = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.488783 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] compression_format = gzip {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.489189 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] compute_api_class = cinder.compute.nova.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.489616 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] config_dir = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.489927 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.490304 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] config_source = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.490689 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.491091 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] control_exchange = openstack {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.491664 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] debug = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.492206 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] default_availability_zone = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.492712 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] default_group_type = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.493542 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.495121 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] default_volume_type = ceph {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.495634 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_client_cert = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.496189 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_client_cert_key = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.496686 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_data_namespace = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.497195 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_ssl_cert_path = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.497718 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_ssl_cert_verify = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.498223 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] driver_use_ssl = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.498781 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] enable_force_upload = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.499227 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] enable_new_services = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.499722 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] enable_unsupported_driver = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.500302 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] enabled_backends = ['ceph'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.500631 ncdv-master-1 cinder-volume[134842]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Mar 26 20:40:09.501388 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] enforce_multipath_for_image_xfer = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.501900 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] filter_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.502395 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_api_insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.502942 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_api_servers = ['http://10.222.0.16/image'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.503466 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_api_ssl_compression = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.503998 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_ca_certificates_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.504560 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_catalog_info = image:glance:publicURL {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.505053 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.505696 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.506228 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.506716 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_num_retries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.507203 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] glance_request_timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.507721 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] goodness_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.508309 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] graceful_shutdown_timeout = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.508821 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] group_api_class = cinder.group.api.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.509265 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] host = ncdv-master-1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.509784 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iet_conf = /etc/iet/ietd.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.510312 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_compress_on_upload = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.510828 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_conversion_address_space_limit = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.511344 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_conversion_cpu_limit = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.512140 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.512644 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_upload_use_cinder_backend = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.513134 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_upload_use_internal_tenant = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.513648 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_volume_cache_enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.514663 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_volume_cache_max_count = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.515168 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] image_volume_cache_max_size_gb = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.515701 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] init_host_max_objects_retrieval = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.516249 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] instance_format = [instance: %(uuid)s] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.516776 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.517304 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iscsi_iotype = fileio {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.517836 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iscsi_secondary_ip_addresses = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.518345 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iscsi_target_flags = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.518856 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iscsi_write_cache = on {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.519387 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iser_helper = tgtadm {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.520202 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iser_ip_address = 10.222.0.16 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.520767 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iser_port = 3260 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.521304 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.521843 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_config_append = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.522373 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.522882 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_dir = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.523402 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.523847 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_options = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.524432 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_rotate_interval = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.524974 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_rotate_interval_type = days {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.525486 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] log_rotation_type = none {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.528670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.528670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.528670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.528670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.528670 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.530449 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] max_age = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.530449 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] max_logfile_count = 30 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.530449 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] max_logfile_size_mb = 200 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.530449 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] max_over_subscription_ratio = 20.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.530449 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] message_reap_interval = 86400 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.531115 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] message_ttl = 2592000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.531684 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] migration_create_volume_timeout_secs = 300 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.532257 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] monkey_patch = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.532842 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] monkey_patch_modules = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.533333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] my_ip = 10.222.0.16 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] no_snapshot_gb_quota = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] num_iser_scan_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] num_shell_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] num_volume_device_scan_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] nvmet_ns_id = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] nvmet_port_id = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577065 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_max_limit = 1000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_ext_list = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_listen = 0.0.0.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_listen_port = 8776 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_use_ssl = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.577693 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] osapi_volume_workers = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] per_volume_size_limit = -1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] periodic_fuzzy_delay = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] periodic_interval = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] project_id_regex = [0-9a-f\-]+ {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] public_endpoint = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] publish_errors = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_backup_gigabytes = 1000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578652 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_backups = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578728 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Starting volume driver RBDDriver (1.2.0) Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_consistencygroups = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_gigabytes = 1000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_groups = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_snapshots = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] quota_volumes = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.578805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] rate_limit_burst = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579270 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] rate_limit_except_level = CRITICAL {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579270 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] rate_limit_interval = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579270 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] reinit_driver_count = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579270 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] replication_device = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] report_discard_supported = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] report_interval = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] reservation_clean_interval = 86400 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] reservation_expire = 86400 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] reserved_percentage = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.579607 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] rpc_response_timeout = 120 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] run_external_periodic_tasks = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] scst_target_driver = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580015 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] scst_target_iqn_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_down_time = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] snapshot_name_template = snapshot-%s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] snapshot_same_host = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] split_loggers = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] state_path = /opt/stack/data/cinder {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] storage_availability_zone = nova {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.580768 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] storage_protocol = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] syslog_log_facility = LOG_USER {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] target_helper = lioadm {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] target_ip_address = 10.222.0.16 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] target_port = 3260 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.581354 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] target_protocol = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] trace_flags = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] transfer_api_class = cinder.transfer.api.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] transport_url = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] until_refresh = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_chap_auth = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_default_quota_class = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582333 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_eventlog = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_journal = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_json = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_multipath_for_image_xfer = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_stderr = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] use_syslog = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] verify_glance_signatures = enabled {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.582829 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_api_class = cinder.volume.api.API {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_backend_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_clear = zero {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_clear_ionice = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_clear_size = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_copy_bps_limit = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583252 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_dd_blocksize = 1M {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_name_template = volume-%s {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_service_inithost_offload = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volume_usage_audit_period = month {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.583727 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] watch_log_file = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] zoning_mode = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.enforce_new_defaults = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.enforce_scope = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584137 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.policy_default_rule = default {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.policy_file = policy.yaml {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_concurrency.disable_process_locking = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.admin_password = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.584921 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.admin_token = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.admin_user = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_admin_prefix = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_port = 35357 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_protocol = https {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_section = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_type = password {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_uri = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.auth_version = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.cache = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.585848 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.delay_auth_decision = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.http_connect_timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.identity_uri = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.include_service_catalog = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586256 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.interface = public {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.586681 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.587057 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.587057 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.587384 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.587937 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.588230 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.588615 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.region_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.588929 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.589337 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.service_token_roles_required = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.589730 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.service_type = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.590079 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.token_cache_time = 300 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.590437 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.590897 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.backend = dogpile.cache.null {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.591276 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.backend_argument = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.591650 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.config_prefix = cache.oslo {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.592707 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.dead_timeout = 60.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.593090 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.debug_cache_backend = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.593433 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.enable_retry_client = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.593775 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.enable_socket_keepalive = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.594111 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.594454 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.expiration_time = 600 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.594812 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.hashclient_retry_attempts = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.595156 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.hashclient_retry_delay = 1.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.595518 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_dead_retry = 300 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.595879 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.596246 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.596609 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_pool_maxsize = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.596949 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.597336 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.597688 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.memcache_socket_timeout = 1.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.598056 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.proxies = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.598393 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.retry_attempts = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.598738 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.retry_delay = 0.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.599075 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.socket_keepalive_count = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.599425 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.socket_keepalive_idle = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.599780 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.socket_keepalive_interval = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.600133 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.tls_allowed_ciphers = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.600619 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.tls_cafile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.601085 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.tls_certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.601575 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.tls_enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.602037 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cache.tls_keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.602564 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] coordination.backend_url = etcd3+http://10.222.0.16:2379 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.603130 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.backend = sqlalchemy {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.603588 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.connection = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.604119 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.connection_debug = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.604637 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.connection_parameters = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.605140 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.connection_recycle_time = 3600 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.605695 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.connection_trace = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.606241 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.db_inc_retry_interval = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.606601 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.db_max_retries = 20 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.606945 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.db_max_retry_interval = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.607286 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.db_retry_interval = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.607653 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.max_overflow = 50 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.608532 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.max_pool_size = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.608865 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.max_retries = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.609216 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.mysql_enable_ndb = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.609558 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.609893 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.pool_timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.610416 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.retry_interval = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.610938 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.slave_connection = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.611431 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.sqlite_synchronous = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.613326 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] database.use_db_reconnect = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.613919 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.614296 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.614665 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.615023 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.615378 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.615794 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.connection_string = messaging:// {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.616113 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.616473 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.es_doc_type = notification {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.616822 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.es_scroll_size = 10000 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.617187 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.es_scroll_time = 2m {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.617527 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.filter_error_trace = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.617900 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.hmac_keys = SECRET_KEY {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.618249 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.sentinel_service_name = mymaster {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.618600 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.socket_timeout = 0.1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.618949 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] profiler.trace_sqlalchemy = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.619366 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.capabilities = [21] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.619739 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.group = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.622003 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.helper_command = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.622568 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.623082 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.624843 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] privsep_osbrick.user = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.625410 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.625769 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.group = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.626130 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.helper_command = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.626491 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.626858 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.627194 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] cinder_sys_admin.user = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.627363 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:09.627567 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.auth_section = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.627969 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.auth_type = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.628289 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.cafile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.628625 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.628988 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.collect_timing = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.629334 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.629690 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.630039 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.send_service_user_token = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.630382 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.split_loggers = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.630738 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] service_user.timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.631145 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.backend_availability_zone = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.631501 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.631842 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.632218 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.chap_password = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.632567 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.chap_username = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.632953 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.633318 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.634665 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.634665 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_client_cert = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.634665 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_client_cert_key = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.634665 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_data_namespace = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.635534 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.635534 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.635662 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.driver_use_ssl = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.635943 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.enable_deferred_deletion = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.636445 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.enable_unsupported_driver = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.637085 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.637322 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.extra_capabilities = {} {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.637682 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.filter_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.638021 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.goodness_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.638375 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.638718 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.639088 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.639433 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.639877 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.640129 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.640484 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iscsi_iotype = fileio {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.640849 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.641213 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iscsi_target_flags = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.641572 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iscsi_write_cache = on {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.641926 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iser_helper = tgtadm {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.642453 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iser_ip_address = 10.222.0.16 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.642804 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iser_port = 3260 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.643157 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.643532 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.643875 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.644507 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.num_shell_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.645370 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.645882 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.646394 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.nvmet_port_id = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.646939 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.648295 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rados_connection_interval = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.648798 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rados_connection_retries = 3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.649305 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_ceph_conf = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.649818 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.650342 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.650850 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.651341 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.652093 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_pool = rbd {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.652582 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_secret_uuid = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.653061 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.653559 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.rbd_user = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.654069 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.654587 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.replication_device = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.655073 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.report_discard_supported = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.655562 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.656086 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.reserved_percentage = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.656637 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.scst_target_driver = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.657128 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.scst_target_iqn_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.657506 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.storage_protocol = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.657863 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.658219 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.target_helper = tgtadm {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.658905 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.target_ip_address = 10.222.0.16 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.659425 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.target_port = 3260 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.659805 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.660196 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.target_protocol = iscsi {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.660540 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.trace_flags = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.660903 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.unique_fqdn_network = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.661242 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.use_chap_auth = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.661585 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.661928 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_backend_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.662291 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_clear = zero {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.662654 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_clear_ionice = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.662993 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_clear_size = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.663344 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.663854 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.664234 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.664588 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.665239 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.665643 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_reports.file_event_handler = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.666042 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.666397 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_reports.log_dir = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.666780 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.backend_availability_zone = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.667118 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.backend_host = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.667462 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.backend_native_threads_pool_size = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.667794 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.backup_use_temp_snapshot = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.668270 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.chap_password = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.668641 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.chap_username = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.668998 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.chiscsi_conf = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.669363 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.deferred_deletion_delay = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.669701 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.deferred_deletion_purge_interval = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.670037 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_client_cert = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.670950 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_client_cert_key = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.671291 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_data_namespace = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.671626 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_ssl_cert_path = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.671992 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_ssl_cert_verify = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.672345 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.driver_use_ssl = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.672834 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.enable_deferred_deletion = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.673351 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.enable_unsupported_driver = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.673859 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.674260 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.extra_capabilities = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.674522 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.filter_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.674858 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.goodness_function = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.675203 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iet_conf = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.675565 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.image_upload_use_cinder_backend = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.675902 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.image_upload_use_internal_tenant = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.676283 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.image_volume_cache_enabled = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.676629 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.image_volume_cache_max_count = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.676964 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.677304 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iscsi_iotype = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.677643 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.677981 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iscsi_target_flags = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.678337 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iscsi_write_cache = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.678673 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iser_helper = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.679007 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iser_ip_address = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.679345 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iser_port = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.679686 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.iser_target_prefix = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.680051 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.max_over_subscription_ratio = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.680412 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.num_iser_scan_tries = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.680745 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.num_shell_tries = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.681080 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.num_volume_device_scan_tries = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.681415 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.nvmet_ns_id = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.681748 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.nvmet_port_id = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.682113 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rados_connect_timeout = -1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.682454 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rados_connection_interval = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.682792 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rados_connection_retries = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.683144 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.683480 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_cluster_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.683816 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.684212 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.684585 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_max_clone_depth = 5 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.684939 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_pool = volumes {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.685277 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_secret_uuid = 1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.685767 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_store_chunk_size = 4 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.686812 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.rbd_user = cinder {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.687178 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.replication_connect_timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.687592 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.replication_device = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.687955 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.report_discard_supported = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.688304 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.report_dynamic_total_capacity = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.688738 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.reserved_percentage = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.689115 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.scst_target_driver = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.689459 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.scst_target_iqn_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.689914 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.storage_protocol = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.690275 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.690613 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.target_helper = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.690951 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.target_ip_address = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.691296 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.target_port = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.691631 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.target_prefix = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.691991 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.target_protocol = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.692330 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.trace_flags = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.692664 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.unique_fqdn_network = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.692999 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.use_chap_auth = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.693335 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.use_multipath_for_image_xfer = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.693684 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_backend_name = ceph {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.694042 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_clear = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.694377 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_clear_ionice = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.694645 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:09.694743 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_clear_size = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.695046 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.695382 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_copy_bps_limit = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.695717 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_dd_blocksize = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.696087 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.696444 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ceph.volumes_dir = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.696885 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.697253 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.697627 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.697988 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.698365 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.698704 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.699063 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.699404 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.699750 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.700109 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.700465 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.700817 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.701544 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.701781 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.701913 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.702448 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.702958 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.703458 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.703970 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.704461 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.704979 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.705489 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.706043 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.ssl = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.706552 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.707055 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.707756 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.708301 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_rabbit.ssl_version = {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.708785 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_notifications.driver = [] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.709319 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_notifications.retry = -1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.709891 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.710396 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] oslo_messaging_notifications.transport_url = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.710729 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.711028 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] key_manager.fixed_key = **** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.711458 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.711800 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.barbican_api_version = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.712184 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.barbican_endpoint = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.712562 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.barbican_endpoint_type = public {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.712902 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.barbican_region_name = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.713255 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.cafile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.713592 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.713950 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.collect_timing = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.714290 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.714624 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.714966 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.number_of_retries = 60 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.715305 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.retry_delay = 1 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.715651 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.send_service_user_token = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.716016 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.split_loggers = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.716344 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.716682 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.verify_ssl = True {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.717016 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican.verify_ssl_path = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.717672 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.auth_section = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.718007 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.auth_type = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.718342 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.cafile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.718695 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.719054 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.collect_timing = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.719395 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.719751 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.720175 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.split_loggers = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.720517 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] barbican_service_user.timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.720927 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.approle_role_id = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.721272 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.approle_secret_id = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.721604 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.cafile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.721936 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.certfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.722279 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.collect_timing = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.722620 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.insecure = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.723831 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.keyfile = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.725171 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.kv_mountpoint = secret {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.725171 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.kv_version = 2 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.725336 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.namespace = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.725554 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.root_token_id = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.726404 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.split_loggers = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.727096 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.ssl_ca_crt_file = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.727442 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.timeout = None {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.727785 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.use_ssl = False {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.728192 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:40:09.728481 ncdv-master-1 cinder-volume[134669]: DEBUG oslo_service.service [None req-b90820c0-5b7c-4873-be96-a8b48068ce38 None None] ******************************************************************************** {{(pid=134669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:40:09.753205 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.driver [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Driver hasn't implemented _init_vendor_properties() Mar 26 20:40:09.753668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.driver [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:46ba1a55-2d7f-4670-a7f0-529961f9b3b6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Mar 26 20:40:09.767496 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_db.sqlalchemy.engines [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:40:09.807192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.db.sqlalchemy.api [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Building query based on filter {{(pid=134842) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3377}} Mar 26 20:40:09.830342 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Mar 26 20:40:09.836768 ncdv-master-1 cinder-volume[134842]: INFO cinder.keymgr.migration [None req-067f8f26-1cf0-444e-8242-aa1abeef1a2e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Mar 26 20:40:09.848238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:09.883412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:09.922229 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:40:09.960290 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Driver initialization completed successfully. Mar 26 20:40:09.974016 ncdv-master-1 cinder-volume[134842]: INFO cinder.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Initiating service 3 cleanup Mar 26 20:40:09.980937 ncdv-master-1 cinder-volume[134842]: INFO cinder.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Service 3 cleanup completed. Mar 26 20:40:09.981306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.service [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Creating RPC server for service cinder-volume {{(pid=134842) start /opt/stack/cinder/cinder/service.py:231}} Mar 26 20:40:09.989820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.service [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134842) start /opt/stack/cinder/cinder/service.py:237}} Mar 26 20:40:10.048860 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Mar 26 20:40:10.049965 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:10.076754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:40:10.125108 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-351f6155-5a3e-420b-bd3f-1132609f1c0a None None] Driver post RPC initialization completed successfully. Mar 26 20:41:58.127952 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:41:58.128974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:41:58.153288 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:41:58.178170 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:42:58.132657 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:42:58.133975 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:42:58.154770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:42:58.176498 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:43:58.131992 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:43:58.132658 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:43:58.153054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:43:58.174637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:44:58.129692 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:44:58.130365 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:44:58.151236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:44:58.172587 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:45:58.127524 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:45:58.128251 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:45:58.149068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:45:58.169316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:46:58.124633 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:46:58.125305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:46:58.146225 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:46:58.167479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:47:58.122583 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:47:58.123247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:47:58.143958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:47:58.165006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:48:58.120269 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:48:58.120986 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:48:58.195861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:48:58.322786 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:49:58.125678 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:49:58.127337 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:49:58.172449 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:49:58.217508 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:50:58.123762 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:50:58.125710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:50:58.204087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:50:58.256024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:51:00.327022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:51:00.398310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Flow 'volume_create_manager' (67c12fe0-1c62-43ff-8943-dc84354f4a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:00.408496 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42238820-2fa5-4029-b305-a353eeb4e2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.462077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42238820-2fa5-4029-b305-a353eeb4e2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1336928654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8bcafd78-22b6-4646-9380-81d4488a36cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa6068dd8e94d7dbbd6dc1fcc7f236c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:00Z,use_quota=True,user_id='19597b33d62b4218ad7117bd8a520522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.467182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1897b843-7add-461f-9452-45eb01f3be01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.472769 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1897b843-7add-461f-9452-45eb01f3be01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.478878 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c79865d-93c0-4682-b3f9-a5794fb89f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.490800 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c79865d-93c0-4682-b3f9-a5794fb89f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcafd78-22b6-4646-9380-81d4488a36cd', 'volume_name': 'volume-8bcafd78-22b6-4646-9380-81d4488a36cd', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.496191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822fc9f-4b26-4655-a0aa-1617ee12c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.501546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822fc9f-4b26-4655-a0aa-1617ee12c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.507740 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a4f35-f6f4-4beb-a5bd-240a77777f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.510520 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Volume 8bcafd78-22b6-4646-9380-81d4488a36cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcafd78-22b6-4646-9380-81d4488a36cd', 'volume_size': 1} Mar 26 20:51:00.511566 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] creating volume 'volume-8bcafd78-22b6-4646-9380-81d4488a36cd' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:51:00.512726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:00.819693 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:51:00.820376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:51:00.824498 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a4f35-f6f4-4beb-a5bd-240a77777f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcafd78-22b6-4646-9380-81d4488a36cd', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.833277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d20329-ac34-45f2-a753-e5b147a152b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:00.854704 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Volume volume-8bcafd78-22b6-4646-9380-81d4488a36cd (8bcafd78-22b6-4646-9380-81d4488a36cd): created successfully Mar 26 20:51:00.865362 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d20329-ac34-45f2-a753-e5b147a152b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:00.872842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Flow 'volume_create_manager' (67c12fe0-1c62-43ff-8943-dc84354f4a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:00.893633 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7e6467c8-ecff-448d-a3e3-2f5b73f1659b tempest-VolumesAdminNegativeTest-1124448885 None] Created volume successfully. Mar 26 20:51:02.716912 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 req-d1b92ba4-76be-4041-844b-d3cb3e257d80 tempest-VolumesAdminNegativeTest-1124448885 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:03.834909 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 req-d1b92ba4-76be-4041-844b-d3cb3e257d80 tempest-VolumesAdminNegativeTest-1124448885 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.118s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:03.836751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 req-d1b92ba4-76be-4041-844b-d3cb3e257d80 tempest-VolumesAdminNegativeTest-1124448885 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8bcafd78-22b6-4646-9380-81d4488a36cd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '8bcafd78-22b6-4646-9380-81d4488a36cd', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:51:03.887144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 req-d1b92ba4-76be-4041-844b-d3cb3e257d80 tempest-VolumesAdminNegativeTest-1124448885 None] Connection info returned from driver {'name': 'volumes/volume-8bcafd78-22b6-4646-9380-81d4488a36cd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8bcafd78-22b6-4646-9380-81d4488a36cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bd69bac0-7040-46b4-a1f5-e6c120ce5091'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:51:03.975499 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 req-d1b92ba4-76be-4041-844b-d3cb3e257d80 tempest-VolumesAdminNegativeTest-1124448885 None] attachment_update completed successfully. Mar 26 20:51:10.223396 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b req-967f68ed-f7d9-4471-afed-95c74e2b2488 tempest-VolumesAdminNegativeTest-1124448885 None] Terminate volume connection completed successfully. Mar 26 20:51:10.224657 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b req-967f68ed-f7d9-4471-afed-95c74e2b2488 tempest-VolumesAdminNegativeTest-1124448885 None] Deleting attachment bd69bac0-7040-46b4-a1f5-e6c120ce5091. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:51:11.679747 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:51:11.706788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Flow 'volume_create_manager' (3d71e62d-4305-4f85-b99a-26a6650ad9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:11.715134 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45fe794-7fbe-4013-816c-339ba1cc8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.733281 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45fe794-7fbe-4013-816c-339ba1cc8088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1888108104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=691bf6f5-d70c-4f1a-b703-ade41950e2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa6068dd8e94d7dbbd6dc1fcc7f236c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:12Z,use_quota=True,user_id='19597b33d62b4218ad7117bd8a520522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.739813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fbef7b-ebf2-41fb-94c6-1e5c84d7d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.745355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fbef7b-ebf2-41fb-94c6-1e5c84d7d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.753605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ce4714-48d5-4c33-adf1-9eccf3754993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.759182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ce4714-48d5-4c33-adf1-9eccf3754993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691bf6f5-d70c-4f1a-b703-ade41950e2ac', 'volume_name': 'volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.764439 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdb97b2-63c8-40db-88f1-d53183f991ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.769494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdb97b2-63c8-40db-88f1-d53183f991ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.774751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035d0d1-e0a4-4cbf-9edc-4520a9942ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.776672 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Volume 691bf6f5-d70c-4f1a-b703-ade41950e2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac', 'volume_size': 1} Mar 26 20:51:11.777346 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] creating volume 'volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:51:11.778418 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:11.866629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:51:11.867332 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:51:11.876854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035d0d1-e0a4-4cbf-9edc-4520a9942ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.885926 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526b5fcf-512f-4556-b786-ef6157341b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:11.899602 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Volume volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac (691bf6f5-d70c-4f1a-b703-ade41950e2ac): created successfully Mar 26 20:51:11.905003 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526b5fcf-512f-4556-b786-ef6157341b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:11.913196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Flow 'volume_create_manager' (3d71e62d-4305-4f85-b99a-26a6650ad9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:11.929495 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c6bf11bc-dcd6-498e-bc93-0ae02772a545 tempest-VolumesAdminNegativeTest-1124448885 None] Created volume successfully. Mar 26 20:51:13.188426 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Lock "b'cinder-691bf6f5-d70c-4f1a-b703-ade41950e2ac-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:51:13.287729 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:13.392830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:51:13.395880 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Volume volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:51:13.430819 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] deleting rbd volume volume-691bf6f5-d70c-4f1a-b703-ade41950e2ac {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:51:13.834251 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 26 20:51:13.835349 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 26 20:51:13.867714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Created reservations ['05935195-9b90-4d55-9398-707dcd8bbbad', '45eaa974-af2d-4009-a6e5-492ab2efa19d', 'ebcf31b7-0d92-4abc-9b34-2d99760402d6', '023b08d4-3ad1-4e98-a2a9-5f9a6eb70571'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:51:13.983073 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:14.051003 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:14.101861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:51:14.111468 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Deleted volume successfully. Mar 26 20:51:14.126454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-55029c8a-7920-455b-b711-63e22d5ead8a tempest-VolumesAdminNegativeTest-1124448885 None] Lock "b'cinder-691bf6f5-d70c-4f1a-b703-ade41950e2ac-delete_volume'" released by "delete_volume" :: held 0.941s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:51:14.367502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Lock "b'cinder-8bcafd78-22b6-4646-9380-81d4488a36cd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:51:14.416286 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:14.505018 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:51:14.505455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Volume volume-8bcafd78-22b6-4646-9380-81d4488a36cd is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:51:14.513395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] deleting rbd volume volume-8bcafd78-22b6-4646-9380-81d4488a36cd {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:51:14.867054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Created reservations ['33f7a5ee-c6a7-4694-8498-68eca4beeb5d', '6282b9b5-f40c-4aa3-b034-597d13fcb449', '09289b7a-eddd-40da-8b43-b5be9c07dc15', '119d2a69-cbde-4526-9151-210373972d20'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:51:14.929052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:15.007746 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:15.067262 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:51:15.071645 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Deleted volume successfully. Mar 26 20:51:15.087851 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5c9e9687-02aa-476b-9dc1-68625fdff8fe tempest-VolumesAdminNegativeTest-1124448885 None] Lock "b'cinder-8bcafd78-22b6-4646-9380-81d4488a36cd-delete_volume'" released by "delete_volume" :: held 0.720s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:51:15.345192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:51:15.364988 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (a113aa7a-b30f-4a73-a5e9-d069441d745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:15.371582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6781541-01f2-4175-9470-29353634de74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.386999 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6781541-01f2-4175-9470-29353634de74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1240684505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ace3a31-6c6a-489d-a7e5-62054bbbe359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d686cedf4368ae6e500602e64596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:15Z,use_quota=True,user_id='2bcd816c4f3a495cbe7ce636cf0e2f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.395567 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24656be-9923-43c3-af61-cc79a4365b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.399526 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24656be-9923-43c3-af61-cc79a4365b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.410102 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598c2c28-21a6-438a-8bd6-a8590feafb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.414869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598c2c28-21a6-438a-8bd6-a8590feafb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'volume_name': 'volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.420875 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d14ed07-24eb-40e1-a195-534c7cae4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.426468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d14ed07-24eb-40e1-a195-534c7cae4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.431655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4ed379-2c55-4b09-8ca6-909226de959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.432699 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume 3ace3a31-6c6a-489d-a7e5-62054bbbe359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'volume_size': 1} Mar 26 20:51:15.433085 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] creating volume 'volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:51:15.433862 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:15.551512 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:51:15.551512 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:51:15.551512 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4ed379-2c55-4b09-8ca6-909226de959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.555980 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104991d7-cd1d-4d3d-a455-c847c64a3a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:15.569902 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359 (3ace3a31-6c6a-489d-a7e5-62054bbbe359): created successfully Mar 26 20:51:15.574717 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104991d7-cd1d-4d3d-a455-c847c64a3a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:15.581305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (a113aa7a-b30f-4a73-a5e9-d069441d745c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:15.594145 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c4da7ee-86ad-4a9c-946f-fb9b5e0e6971 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created volume successfully. Mar 26 20:51:17.030374 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 req-7dcf528f-487d-472d-989e-d2d28c10e662 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:17.917654 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 req-7dcf528f-487d-472d-989e-d2d28c10e662 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.887s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:17.918452 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 req-7dcf528f-487d-472d-989e-d2d28c10e662 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:51:17.963111 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 req-7dcf528f-487d-472d-989e-d2d28c10e662 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Connection info returned from driver {'name': 'volumes/volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9e6df976-debf-4c32-bb5a-2c0e6c017e3a'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:51:18.081001 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 req-7dcf528f-487d-472d-989e-d2d28c10e662 tempest-LiveAutoBlockMigrationV225Test-521486661 None] attachment_update completed successfully. Mar 26 20:51:18.627546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:51:18.650313 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Flow 'volume_create_manager' (e84275af-1a15-46b7-9b28-8eaaeef07fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:18.658087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8511505e-b285-4c49-b925-d567f9b77964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.678224 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8511505e-b285-4c49-b925-d567f9b77964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1717359625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=332c6932-b720-4149-a33d-66740c6c06f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf51b08278d246e498f59455e299ba89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:19Z,use_quota=True,user_id='c9bd4f2793ec48a5b31d081c269a39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.683594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bcfccc-9136-4568-9a10-7f19c02f6b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.688745 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bcfccc-9136-4568-9a10-7f19c02f6b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.694777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28170c20-ffe1-40c8-a623-7b2e9eff6ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.699473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28170c20-ffe1-40c8-a623-7b2e9eff6ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332c6932-b720-4149-a33d-66740c6c06f2', 'volume_name': 'volume-332c6932-b720-4149-a33d-66740c6c06f2', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.704868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8fae8f-3501-4f28-8e4d-80e0c142fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.708954 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8fae8f-3501-4f28-8e4d-80e0c142fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.713962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3670f8e-4b0a-469c-b12d-ea93fb1a4707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.715077 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Volume 332c6932-b720-4149-a33d-66740c6c06f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332c6932-b720-4149-a33d-66740c6c06f2', 'volume_size': 1} Mar 26 20:51:18.715496 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] creating volume 'volume-332c6932-b720-4149-a33d-66740c6c06f2' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:51:18.716351 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:18.799224 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:51:18.799606 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:51:18.803277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3670f8e-4b0a-469c-b12d-ea93fb1a4707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332c6932-b720-4149-a33d-66740c6c06f2', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.807866 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cf4a93-c36a-4ed9-8653-636ff69c031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:18.831310 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Volume volume-332c6932-b720-4149-a33d-66740c6c06f2 (332c6932-b720-4149-a33d-66740c6c06f2): created successfully Mar 26 20:51:18.835122 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cf4a93-c36a-4ed9-8653-636ff69c031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:18.840580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Flow 'volume_create_manager' (e84275af-1a15-46b7-9b28-8eaaeef07fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:18.862873 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a5321954-80dd-4198-8d38-f8c0e519fc6c tempest-LiveMigrationTest-1414077140 None] Created volume successfully. Mar 26 20:51:20.075122 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 req-8f6fa453-ad09-4cfc-988a-15e2e1da3b1d tempest-LiveMigrationTest-1414077140 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:21.066421 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 req-8f6fa453-ad09-4cfc-988a-15e2e1da3b1d tempest-LiveMigrationTest-1414077140 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.992s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:21.067333 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 req-8f6fa453-ad09-4cfc-988a-15e2e1da3b1d tempest-LiveMigrationTest-1414077140 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-332c6932-b720-4149-a33d-66740c6c06f2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '332c6932-b720-4149-a33d-66740c6c06f2', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:51:21.100693 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 req-8f6fa453-ad09-4cfc-988a-15e2e1da3b1d tempest-LiveMigrationTest-1414077140 None] Connection info returned from driver {'name': 'volumes/volume-332c6932-b720-4149-a33d-66740c6c06f2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '332c6932-b720-4149-a33d-66740c6c06f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '50058eea-2dfc-4faa-b279-aa865012ce9a'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:51:21.230275 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 req-8f6fa453-ad09-4cfc-988a-15e2e1da3b1d tempest-LiveMigrationTest-1414077140 None] attachment_update completed successfully. Mar 26 20:51:25.813557 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-6793f1b3-6bdb-426e-9930-74fae997d051 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:26.540174 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-6793f1b3-6bdb-426e-9930-74fae997d051 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.728s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:26.540829 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-6793f1b3-6bdb-426e-9930-74fae997d051 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:51:26.576064 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-6793f1b3-6bdb-426e-9930-74fae997d051 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Connection info returned from driver {'name': 'volumes/volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ace3a31-6c6a-489d-a7e5-62054bbbe359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '533f9071-8d18-452e-b279-9b0867d37709'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:51:26.636674 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-6793f1b3-6bdb-426e-9930-74fae997d051 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] attachment_update completed successfully. Mar 26 20:51:36.653997 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-f258c0bb-c946-4799-8b19-73602b805e04 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Terminate volume connection completed successfully. Mar 26 20:51:36.654646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-73716ad7-cb45-4714-a69b-a328a46460e2 req-f258c0bb-c946-4799-8b19-73602b805e04 tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Deleting attachment 9e6df976-debf-4c32-bb5a-2c0e6c017e3a. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:51:42.458521 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-a216e451-23db-4990-82ca-b89f4469e2ad tempest-LiveMigrationTest-1397668550 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:43.392824 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-a216e451-23db-4990-82ca-b89f4469e2ad tempest-LiveMigrationTest-1397668550 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.934s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:43.393651 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-a216e451-23db-4990-82ca-b89f4469e2ad tempest-LiveMigrationTest-1397668550 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-332c6932-b720-4149-a33d-66740c6c06f2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '332c6932-b720-4149-a33d-66740c6c06f2', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:51:43.429848 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-a216e451-23db-4990-82ca-b89f4469e2ad tempest-LiveMigrationTest-1397668550 None] Connection info returned from driver {'name': 'volumes/volume-332c6932-b720-4149-a33d-66740c6c06f2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '332c6932-b720-4149-a33d-66740c6c06f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9021707c-bb37-4a28-a959-01cd344740df'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:51:43.500791 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-a216e451-23db-4990-82ca-b89f4469e2ad tempest-LiveMigrationTest-1397668550 None] attachment_update completed successfully. Mar 26 20:51:44.421023 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 req-f48d4452-5e66-4c30-aea8-44d68e87d7ad tempest-LiveAutoBlockMigrationV225Test-521486661 None] Terminate volume connection completed successfully. Mar 26 20:51:44.423387 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 req-f48d4452-5e66-4c30-aea8-44d68e87d7ad tempest-LiveAutoBlockMigrationV225Test-521486661 None] Deleting attachment 533f9071-8d18-452e-b279-9b0867d37709. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:51:45.705210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:51:45.726756 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (dbf8245e-da90-4b30-84af-f8f7e361821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:51:45.734380 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edb7617-231a-4653-ab27-2fd0085b1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:45.750316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edb7617-231a-4653-ab27-2fd0085b1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-248008320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a3f4905-eb37-4708-be4e-acc1bdcab8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d686cedf4368ae6e500602e64596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:46Z,use_quota=True,user_id='2bcd816c4f3a495cbe7ce636cf0e2f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:45.755716 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8567686-5287-4676-a413-e93620f1b79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:45.760277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8567686-5287-4676-a413-e93620f1b79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:45.765935 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09532bc3-62d0-43f4-93d2-3250d4f1329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:45.904873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09532bc3-62d0-43f4-93d2-3250d4f1329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'volume_name': 'volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:45.918698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702e2039-ebba-44bc-bcb2-575f4ce221f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:45.930876 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702e2039-ebba-44bc-bcb2-575f4ce221f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:51:45.939866 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a255e738-bafd-428d-99e4-6bd58c9e2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:51:45.941292 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume 2a3f4905-eb37-4708-be4e-acc1bdcab8e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 20:51:45.941974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Cloning 2a3f4905-eb37-4708-be4e-acc1bdcab8e6 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 20:51:45.968356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:51:45.986396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Preparing cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}} Mar 26 20:51:45.987764 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 20:51:55.384131 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-3c782065-be5a-4824-9104-c0333b4cd8e4 tempest-LiveMigrationTest-1397668550 None] Terminate volume connection completed successfully. Mar 26 20:51:55.384832 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b req-3c782065-be5a-4824-9104-c0333b4cd8e4 tempest-LiveMigrationTest-1397668550 None] Deleting attachment 50058eea-2dfc-4faa-b279-aa865012ce9a. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:51:58.122639 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:51:58.125716 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:58.198610 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:51:58.270776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:52:02.322090 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph, size 616.00 MB, duration 16.32 sec {{(pid=134842) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Mar 26 20:52:02.324192 ncdv-master-1 cinder-volume[134842]: INFO cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Image download 616.00 MB at 37.75 MB/s Mar 26 20:52:02.377183 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:02.605835 ncdv-master-1 sudo[144510]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph Mar 26 20:52:02.606693 ncdv-master-1 sudo[144510]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:04.433541 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-e4e4e814-e564-4826-b48f-65840cb969a1 req-4d91ffbf-4363-4265-bfd4-b8a71de390f9 tempest-LiveMigrationTest-1414077140 None] Terminate volume connection completed successfully. Mar 26 20:52:04.434157 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-e4e4e814-e564-4826-b48f-65840cb969a1 req-4d91ffbf-4363-4265-bfd4-b8a71de390f9 tempest-LiveMigrationTest-1414077140 None] Deleting attachment 9021707c-bb37-4a28-a959-01cd344740df. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:52:04.458198 ncdv-master-1 sudo[144510]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:04.460326 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph" returned: 0 in 2.083s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:04.471303 ncdv-master-1 cinder-volume[134842]: WARNING py.warnings [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 26 20:52:04.471303 ncdv-master-1 cinder-volume[134842]: debtcollector.deprecate( Mar 26 20:52:04.471303 ncdv-master-1 cinder-volume[134842]: Mar 26 20:52:04.472042 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Temporary image 4c68d3e3-5768-41fa-883a-78a7564bdbcb is fetched for user 2bcd816c4f3a495cbe7ce636cf0e2f8a. {{(pid=134842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Mar 26 20:52:04.586383 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:04.726427 ncdv-master-1 sudo[144549]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph Mar 26 20:52:04.728305 ncdv-master-1 sudo[144549]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:06.501233 ncdv-master-1 sudo[144549]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:06.503499 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph" returned: 0 in 1.917s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:06.504569 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] creating volume 'volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:52:06.505780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:06.632741 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:52:06.633449 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:52:06.671825 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Attempting download of 4c68d3e3-5768-41fa-883a-78a7564bdbcb ((None, None)) to volume 2a3f4905-eb37-4708-be4e-acc1bdcab8e6. {{(pid=134842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Mar 26 20:52:06.734766 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4c68d3e3-5768-41fa-883a-78a7564bdbcb_ox7i904h {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:06.920485 ncdv-master-1 sudo[144630]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4c68d3e3-5768-41fa-883a-78a7564bdbcb_ox7i904h Mar 26 20:52:06.921321 ncdv-master-1 sudo[144630]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:07.030897 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:52:07.059103 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Flow 'volume_create_manager' (44730d9e-5a02-4429-ac8e-624d01893e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:52:07.066842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc35a13e-bf4f-453b-b391-edac33e4b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:07.088916 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc35a13e-bf4f-453b-b391-edac33e4b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-702276378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f544925-67cf-4072-b082-f5f62fb093c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf51b08278d246e498f59455e299ba89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:52:07Z,use_quota=True,user_id='c9bd4f2793ec48a5b31d081c269a39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:07.095745 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a9f645-c884-46bf-8db1-0830e889db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:07.101874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a9f645-c884-46bf-8db1-0830e889db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:07.112413 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79bb298-9166-46ee-bcea-b8dae3fd4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:07.251411 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79bb298-9166-46ee-bcea-b8dae3fd4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f544925-67cf-4072-b082-f5f62fb093c7', 'volume_name': 'volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:07.271251 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4bcac4-cc1f-45b2-972e-5d37b56540d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:07.279645 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4bcac4-cc1f-45b2-972e-5d37b56540d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:07.296022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f54b1a-0ad7-44b6-a544-313c07a5c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:07.305365 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Volume 2f544925-67cf-4072-b082-f5f62fb093c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 20:52:07.306135 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Cloning 2f544925-67cf-4072-b082-f5f62fb093c7 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 20:52:08.994283 ncdv-master-1 sudo[144630]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:08.996664 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4c68d3e3-5768-41fa-883a-78a7564bdbcb_ox7i904h" returned: 0 in 2.263s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:08.997884 ncdv-master-1 cinder-volume[134842]: WARNING py.warnings [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 26 20:52:08.997884 ncdv-master-1 cinder-volume[134842]: debtcollector.deprecate( Mar 26 20:52:08.997884 ncdv-master-1 cinder-volume[134842]: Mar 26 20:52:08.999314 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:09.141951 ncdv-master-1 sudo[144646]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph Mar 26 20:52:09.143309 ncdv-master-1 sudo[144646]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:10.995455 ncdv-master-1 sudo[144646]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:11.000208 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph" returned: 0 in 1.999s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:11.001793 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] 4c68d3e3-5768-41fa-883a-78a7564bdbcb was vhdx, converting to raw {{(pid=134842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Mar 26 20:52:11.005010 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpe5evndsx {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:11.047177 ncdv-master-1 sudo[144733]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpe5evndsx Mar 26 20:52:11.052522 ncdv-master-1 sudo[144733]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:13.777479 ncdv-master-1 sudo[144733]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:13.780885 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpe5evndsx" returned: 0 in 2.777s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:13.786329 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:14.030777 ncdv-master-1 sudo[144791]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph Mar 26 20:52:14.031703 ncdv-master-1 sudo[144791]: pam_unix(sudo:session): session opened for user root by (uid=0) Mar 26 20:52:16.066573 ncdv-master-1 sudo[144791]: pam_unix(sudo:session): session closed for user root Mar 26 20:52:16.070358 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph" returned: 0 in 2.285s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:16.071841 ncdv-master-1 cinder-volume[134842]: WARNING py.warnings [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Mar 26 20:52:16.071841 ncdv-master-1 cinder-volume[134842]: debtcollector.deprecate( Mar 26 20:52:16.071841 ncdv-master-1 cinder-volume[134842]: Mar 26 20:52:16.075359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c68d3e3-5768-41fa-883a-78a7564bdbcb_nr69fdmsncdv-master-1@ceph, size 700.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/conversion/tmpe5evndsx {{(pid=134842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Mar 26 20:52:16.076207 ncdv-master-1 cinder-volume[134842]: INFO cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Converted 700.00 MB image at 251.73 MB/s Mar 26 20:52:16.089211 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:16.192547 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:52:16.193037 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:52:16.200615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] deleting rbd volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:52:16.558519 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpe5evndsx volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:22.389313 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpe5evndsx volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.831s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:22.564397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:22.697309 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:52:22.698092 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:52:22.698736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Downloaded image 4c68d3e3-5768-41fa-883a-78a7564bdbcb ((None, None)) to volume 2a3f4905-eb37-4708-be4e-acc1bdcab8e6 successfully. {{(pid=134842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Mar 26 20:52:22.772131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Temporary image 4c68d3e3-5768-41fa-883a-78a7564bdbcb for user 2bcd816c4f3a495cbe7ce636cf0e2f8a is deleted. {{(pid=134842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Mar 26 20:52:22.882704 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created reservations ['7fde6aa8-e8a0-40d8-b884-e064a78d3358', '24d6ea84-b8bc-455b-8af3-9e1ef36b7a83', '2f9d5d42-2f54-4c0b-aaa4-220907511d19', '601190f4-80ca-4d8c-8564-990285be8e1e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:52:22.893160 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Creating image volume entry: {'provider_geometry': None, 'replication_driver_data': None, 'created_at': datetime.datetime(2022, 3, 26, 20, 51, 45, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'ec2_id': None, 'bootable': False, 'launched_at': None, 'metadata': {}, 'volume_admin_metadata': [], 'availability_zone': 'nova', 'display_description': None, 'size': 1, 'volume_metadata': [], 'terminated_at': None, 'service_uuid': None, 'replication_status': None, 'group_id': None, 'multiattach': False, 'shared_targets': True, 'updated_at': datetime.datetime(2022, 3, 26, 20, 51, 46, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'consistencygroup_id': None, 'provider_id': None, 'volume_type_id': 'dc2ff8a3-d3a4-4420-b6ba-5ead32766b23', 'provider_auth': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'replication_extended_status': None, 'display_name': 'image-4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'host': 'ncdv-master-1@ceph#ceph', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'cluster_name': None, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'previous_status': None, 'scheduled_at': datetime.datetime(2022, 3, 26, 20, 51, 46, tzinfo=datetime.timezone.utc), 'deleted': False, 'provider_location': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6'}. {{(pid=134842) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}} Mar 26 20:52:22.986278 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume reschedule parameters: False retry: None {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:52:23.026820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (6654c0bd-ed2c-44cc-9105-a1ff42596ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:52:23.035838 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e8905-53f5-4324-b323-6514d3ad05c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:23.060472 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e8905-53f5-4324-b323-6514d3ad05c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4c68d3e3-5768-41fa-883a-78a7564bdbcb',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abca8fe3-d56e-4a4a-ab6a-c810b06253ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d311a58db4c44ebbd88fbdf463fab47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2a3f4905-eb37-4708-be4e-acc1bdcab8e6,status='creating',terminated_at=None,updated_at=2022-03-26T20:51:46Z,use_quota=True,user_id='2bcd816c4f3a495cbe7ce636cf0e2f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:23.069573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e95d26-cfcd-407f-9c9e-16680daac1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:23.079328 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e95d26-cfcd-407f-9c9e-16680daac1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:23.092257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f2eb9a-5333-4c0b-9f16-459fe8224eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:23.114502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f2eb9a-5333-4c0b-9f16-459fe8224eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'volume_name': 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'volume_size': 1, 'source_volid': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'source_volstatus': 'downloading'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:23.126777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2817b-f4dc-461e-adc7-c1a9b06dadfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:23.130916 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da2817b-f4dc-461e-adc7-c1a9b06dadfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:23.136820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c4780-2f4b-4a35-b807-1a05f6dd1b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:23.137946 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'volume_size': 1, 'source_volid': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'source_volstatus': 'downloading'} Mar 26 20:52:23.172035 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:23.229902 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] creating snapshot='volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 20:52:24.256062 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] cloning 'volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6@volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac.clone_snap' to 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 20:52:24.404759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:52:24.406643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:52:24.407029 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:52:24.425630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 20:52:24.429657 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c4780-2f4b-4a35-b807-1a05f6dd1b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'volume_size': 1, 'source_volid': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'source_volstatus': 'downloading'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:24.435118 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16c0d6d-f0e1-4726-8d0e-bfbe1f43de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:24.445633 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac (abca8fe3-d56e-4a4a-ab6a-c810b06253ac): created successfully Mar 26 20:52:24.449736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16c0d6d-f0e1-4726-8d0e-bfbe1f43de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:24.455495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (6654c0bd-ed2c-44cc-9105-a1ff42596ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:52:24.463623 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created volume successfully. Mar 26 20:52:24.494772 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Creating new image-volume cache entry for image 4c68d3e3-5768-41fa-883a-78a7564bdbcb on ncdv-master-1@ceph#ceph {{(pid=134842) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Mar 26 20:52:24.503099 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] New image-volume cache entry created: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 20, 52, 24, 497917)}. {{(pid=134842) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Mar 26 20:52:24.507635 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 38.539s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:52:24.508304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Marking volume 2a3f4905-eb37-4708-be4e-acc1bdcab8e6 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 20:52:24.516471 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 2a3f4905-eb37-4708-be4e-acc1bdcab8e6. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 20:52:24.516932 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Creating volume glance metadata for volume 2a3f4905-eb37-4708-be4e-acc1bdcab8e6 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 20:52:24.575628 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a255e738-bafd-428d-99e4-6bd58c9e2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:24.580359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241534b5-954b-4f2b-80ae-12e2c43c88e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:24.588791 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 (2a3f4905-eb37-4708-be4e-acc1bdcab8e6): created successfully Mar 26 20:52:24.592416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241534b5-954b-4f2b-80ae-12e2c43c88e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:24.599619 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Flow 'volume_create_manager' (dbf8245e-da90-4b30-84af-f8f7e361821b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:52:24.608462 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3d6c5e7c-f041-48a2-a5ee-5197dee99de8 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created volume successfully. Mar 26 20:52:25.283977 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 17.975s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:52:25.300737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 20, 52, 25, 291215)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 20:52:25.301564 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 20:52:25.302215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 20:52:25.309390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:52:25.310598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 20:52:25.317318 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 20, 52, 25, 314675)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 20:52:25.318050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 20:52:25.318628 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 20:52:25.334361 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:25.415583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] creating snapshot='volume-2f544925-67cf-4072-b082-f5f62fb093c7.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 20:52:26.290469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-2f544925-67cf-4072-b082-f5f62fb093c7.clone_snap' to 'volume-2f544925-67cf-4072-b082-f5f62fb093c7' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 20:52:26.502642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:52:26.503799 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:52:26.504447 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:52:26.543222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 20:52:26.543544 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Marking volume 2f544925-67cf-4072-b082-f5f62fb093c7 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 20:52:26.555635 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 2f544925-67cf-4072-b082-f5f62fb093c7. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 20:52:26.556085 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Creating volume glance metadata for volume 2f544925-67cf-4072-b082-f5f62fb093c7 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 20:52:26.627757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f54b1a-0ad7-44b6-a544-313c07a5c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:26.634751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e860e2f-1c20-4369-a157-8b52504651db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:52:26.643241 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Volume volume-2f544925-67cf-4072-b082-f5f62fb093c7 (2f544925-67cf-4072-b082-f5f62fb093c7): created successfully Mar 26 20:52:26.646957 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e860e2f-1c20-4369-a157-8b52504651db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:52:26.654047 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Flow 'volume_create_manager' (44730d9e-5a02-4429-ac8e-624d01893e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:52:26.662696 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0d1d9cdb-8932-41b8-a12b-744fd72c1988 tempest-LiveMigrationTest-1414077140 None] Created volume successfully. Mar 26 20:52:27.557884 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 req-a3cc5299-20a6-4537-a211-da9fa4af23e5 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:28.545201 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 req-a3cc5299-20a6-4537-a211-da9fa4af23e5 tempest-LiveAutoBlockMigrationV225Test-521486661 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.987s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:28.546627 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 req-a3cc5299-20a6-4537-a211-da9fa4af23e5 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:52:28.593855 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 req-a3cc5299-20a6-4537-a211-da9fa4af23e5 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Connection info returned from driver {'name': 'volumes/volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe1f4c47-2fb7-4382-ae84-6aa7c6fbf801'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:52:28.699615 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 req-a3cc5299-20a6-4537-a211-da9fa4af23e5 tempest-LiveAutoBlockMigrationV225Test-521486661 None] attachment_update completed successfully. Mar 26 20:52:30.171816 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f req-9be7ac4f-edd5-44d8-80f5-3a6ec3e36a3e tempest-LiveMigrationTest-1414077140 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:30.941687 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f req-9be7ac4f-edd5-44d8-80f5-3a6ec3e36a3e tempest-LiveMigrationTest-1414077140 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.770s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:30.942421 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f req-9be7ac4f-edd5-44d8-80f5-3a6ec3e36a3e tempest-LiveMigrationTest-1414077140 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '2f544925-67cf-4072-b082-f5f62fb093c7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:52:30.981338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f req-9be7ac4f-edd5-44d8-80f5-3a6ec3e36a3e tempest-LiveMigrationTest-1414077140 None] Connection info returned from driver {'name': 'volumes/volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f544925-67cf-4072-b082-f5f62fb093c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fd3aa832-46a8-42f3-a1a9-d8e7ab3059d5'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:52:31.050622 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f req-9be7ac4f-edd5-44d8-80f5-3a6ec3e36a3e tempest-LiveMigrationTest-1414077140 None] attachment_update completed successfully. Mar 26 20:52:47.493043 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-d7da97d1-69ff-4609-8769-6d84cca7569d tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:52:48.470322 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-d7da97d1-69ff-4609-8769-6d84cca7569d tempest-LiveAutoBlockMigrationV225Test-1196014644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.977s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:52:48.471119 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-d7da97d1-69ff-4609-8769-6d84cca7569d tempest-LiveAutoBlockMigrationV225Test-1196014644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:52:48.503293 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-d7da97d1-69ff-4609-8769-6d84cca7569d tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Connection info returned from driver {'name': 'volumes/volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2a3f4905-eb37-4708-be4e-acc1bdcab8e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '09ac40e1-853f-48d4-af66-6425be9be3b7'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:52:48.575231 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-d7da97d1-69ff-4609-8769-6d84cca7569d tempest-LiveAutoBlockMigrationV225Test-1196014644 None] attachment_update completed successfully. Mar 26 20:52:57.165301 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-4230a864-1e79-4299-b652-8aac0048469f tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Terminate volume connection completed successfully. Mar 26 20:52:57.166040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-aa7eefb7-42f6-4e8f-a889-454570cb51cd req-4230a864-1e79-4299-b652-8aac0048469f tempest-LiveAutoBlockMigrationV225Test-1196014644 None] Deleting attachment fe1f4c47-2fb7-4382-ae84-6aa7c6fbf801. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:52:58.125275 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:52:58.125275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:58.218334 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:52:58.304706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:53:04.459308 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-a98c4fbd-287d-463a-b230-8dd5ad2fae45 tempest-LiveMigrationTest-1397668550 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:53:05.292045 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-a98c4fbd-287d-463a-b230-8dd5ad2fae45 tempest-LiveMigrationTest-1397668550 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.832s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:53:05.293316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-a98c4fbd-287d-463a-b230-8dd5ad2fae45 tempest-LiveMigrationTest-1397668550 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '2f544925-67cf-4072-b082-f5f62fb093c7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:53:05.346617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-a98c4fbd-287d-463a-b230-8dd5ad2fae45 tempest-LiveMigrationTest-1397668550 None] Connection info returned from driver {'name': 'volumes/volume-2f544925-67cf-4072-b082-f5f62fb093c7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f544925-67cf-4072-b082-f5f62fb093c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5fb8a9ea-7009-4573-8b0f-d307c9605abd'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:53:05.440800 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-a98c4fbd-287d-463a-b230-8dd5ad2fae45 tempest-LiveMigrationTest-1397668550 None] attachment_update completed successfully. Mar 26 20:53:07.344087 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-78ed6450-0183-4166-9319-b72f018025c4 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Terminate volume connection completed successfully. Mar 26 20:53:07.345502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-78ed6450-0183-4166-9319-b72f018025c4 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Deleting attachment 09ac40e1-853f-48d4-af66-6425be9be3b7. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:53:07.494629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-2a3f4905-eb37-4708-be4e-acc1bdcab8e6-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:53:07.567576 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:07.673607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:53:07.674394 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] volume has clone snapshot(s) {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1284}} Mar 26 20:53:07.675777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:53:07.836701 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created reservations ['b78a4382-c70e-4d60-ae08-57dc9b7e956e', '72c0e322-e4c9-408c-8daf-a8312f473134', '38a295d2-e326-40fc-abd3-4d5a4426f3c2', '9214a79e-b5e1-44d1-915c-379a7e25203e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:53:07.925861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:07.984314 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:08.050742 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:53:08.061151 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Deleted volume successfully. Mar 26 20:53:08.078557 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 req-d7504100-1b27-4c43-a53d-23473412ede7 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-2a3f4905-eb37-4708-be4e-acc1bdcab8e6-delete_volume'" released by "delete_volume" :: held 0.583s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:53:08.297954 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-3ace3a31-6c6a-489d-a7e5-62054bbbe359-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:53:08.358039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:08.514876 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:53:08.516500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Volume volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:53:08.526318 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] deleting rbd volume volume-3ace3a31-6c6a-489d-a7e5-62054bbbe359 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:53:08.962636 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Created reservations ['fdcbeb83-e6c4-4e0a-a4de-b288b505220c', 'c82e40eb-14ea-4d6e-bc7b-2ab104129e5a', '12ace152-f12b-4eb8-b38d-c4ef1c5a9172', '81ba2963-5be1-414c-bca5-cb47501a2a36'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:53:09.058394 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:09.149327 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:09.249185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:53:09.254081 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Deleted volume successfully. Mar 26 20:53:09.281917 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7df6abf9-a841-4ed2-ac80-f8d809120ce9 tempest-LiveAutoBlockMigrationV225Test-521486661 None] Lock "b'cinder-3ace3a31-6c6a-489d-a7e5-62054bbbe359-delete_volume'" released by "delete_volume" :: held 0.984s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:53:13.574464 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-deed0607-683e-4b2a-9dff-5d892b175c89 tempest-LiveMigrationTest-1397668550 None] Terminate volume connection completed successfully. Mar 26 20:53:13.575069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-80d62378-63bd-4531-a4e1-f79029a77d7a req-deed0607-683e-4b2a-9dff-5d892b175c89 tempest-LiveMigrationTest-1397668550 None] Deleting attachment fd3aa832-46a8-42f3-a1a9-d8e7ab3059d5. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:53:25.578312 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-61602a69-62ae-4822-974a-77dc991a7a70 tempest-LiveMigrationTest-1414077140 None] Terminate volume connection completed successfully. Mar 26 20:53:25.578993 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-61602a69-62ae-4822-974a-77dc991a7a70 tempest-LiveMigrationTest-1414077140 None] Deleting attachment 5fb8a9ea-7009-4573-8b0f-d307c9605abd. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:53:25.785080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-2f544925-67cf-4072-b082-f5f62fb093c7-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:53:25.863565 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:26.084574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:53:26.101098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] deleting rbd volume volume-2f544925-67cf-4072-b082-f5f62fb093c7 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:53:26.591835 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 20:53:26.639223 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] deleting parent snapshot volume-2f544925-67cf-4072-b082-f5f62fb093c7.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 20:53:27.668806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-332c6932-b720-4149-a33d-66740c6c06f2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:53:27.719294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:27.772358 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:53:27.772968 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Volume volume-332c6932-b720-4149-a33d-66740c6c06f2 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:53:27.781005 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] deleting rbd volume volume-332c6932-b720-4149-a33d-66740c6c06f2 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:53:27.795965 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] Created reservations ['5fd6e63e-5420-4d15-87f7-4c3fc6e0832a', 'e47bc55f-b035-4dce-b5e6-41bd6e073594', '7a47308d-68ce-43f9-ba42-37e4a830377b', '36fa2b69-481e-4cb7-ad17-70a03f8d4383'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:53:27.884002 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:27.960628 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:28.038513 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:53:28.043097 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] Deleted volume successfully. Mar 26 20:53:28.065139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-099f32c4-e33e-432c-b05a-4bab7a1bced9 req-06d1a7a9-73fc-4856-a3c2-13b4901c90fb tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-2f544925-67cf-4072-b082-f5f62fb093c7-delete_volume'" released by "delete_volume" :: held 2.280s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:53:28.197342 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Created reservations ['3e84de02-96f6-4f7a-b2ab-0fc45b9f8223', '8ac323e7-54f9-4dff-8f8f-29b90ca99789', '45075567-9885-46f3-a341-23da3141a7d6', '02c7919c-92d2-4005-bb84-ffd761b669c5'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:53:28.276484 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:28.344730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:28.394299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:53:28.402349 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Deleted volume successfully. Mar 26 20:53:28.428299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ac227a8a-06d2-437c-a75e-08939cd6348e tempest-LiveMigrationTest-1414077140 None] Lock "b'cinder-332c6932-b720-4149-a33d-66740c6c06f2-delete_volume'" released by "delete_volume" :: held 0.760s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:53:58.123095 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:53:58.123810 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:58.170213 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:53:58.251661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:54:58.122391 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:54:58.123857 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:54:58.260309 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:54:58.388448 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:55:51.126834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:55:51.175613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (fd483b2b-e7ee-4ca2-a99f-634858121e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:51.202927 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e6ca77-d764-4803-bf88-56c142031249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.249279 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e6ca77-d764-4803-bf88-56c142031249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992423282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3751315c-9dc4-4005-8125-589442d464ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb6fc427c1a34e1e82749e6035a27b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:55:51Z,use_quota=True,user_id='890dc80d77a04a8a8a3f2e0194f06ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.266852 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ab8fc2-d16c-4c32-9c6d-a05ca9ac8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.276376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ab8fc2-d16c-4c32-9c6d-a05ca9ac8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.288908 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1c740e-8e6c-4c8c-8362-4a972826f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.295479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1c740e-8e6c-4c8c-8362-4a972826f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3751315c-9dc4-4005-8125-589442d464ee', 'volume_name': 'volume-3751315c-9dc4-4005-8125-589442d464ee', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.313562 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975d0342-da1f-4726-8065-209b0b7b6150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.318647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975d0342-da1f-4726-8065-209b0b7b6150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.326405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695aff4e-1d70-471f-8df1-30cc1e4a29e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.328495 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Volume 3751315c-9dc4-4005-8125-589442d464ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3751315c-9dc4-4005-8125-589442d464ee', 'volume_size': 1} Mar 26 20:55:51.329069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] creating volume 'volume-3751315c-9dc4-4005-8125-589442d464ee' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:55:51.330063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:55:51.495351 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:55:51.496663 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:55:51.503970 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695aff4e-1d70-471f-8df1-30cc1e4a29e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3751315c-9dc4-4005-8125-589442d464ee', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.514260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90513b21-79e8-466d-9039-820951f3a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:51.545730 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Volume volume-3751315c-9dc4-4005-8125-589442d464ee (3751315c-9dc4-4005-8125-589442d464ee): created successfully Mar 26 20:55:51.555097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90513b21-79e8-466d-9039-820951f3a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:51.563266 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (fd483b2b-e7ee-4ca2-a99f-634858121e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:51.588637 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6ecfca0b-55ee-44fa-9181-79b802b9663f tempest-VolumesTestJSON-1881710145 None] Created volume successfully. Mar 26 20:55:54.400193 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:55:54.471960 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (1e7a3a8e-0733-442a-adb9-50ea6d1c0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:54.491200 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95794067-73a8-48b2-adb6-133ab11504a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.539025 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95794067-73a8-48b2-adb6-133ab11504a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-542362991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01e091d3-23ed-4dd3-9ff0-6322c665775f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb6fc427c1a34e1e82749e6035a27b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:55:54Z,use_quota=True,user_id='890dc80d77a04a8a8a3f2e0194f06ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:54.553880 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c6a836-71dd-4acc-8cee-bd73db7cb347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.568183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c6a836-71dd-4acc-8cee-bd73db7cb347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:54.590865 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056268a2-08d0-42ef-af94-2831ccfc6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.604170 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056268a2-08d0-42ef-af94-2831ccfc6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e091d3-23ed-4dd3-9ff0-6322c665775f', 'volume_name': 'volume-01e091d3-23ed-4dd3-9ff0-6322c665775f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:54.616977 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da33cf4-31ea-4763-9e30-084150b8ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.627132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da33cf4-31ea-4763-9e30-084150b8ada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:54.643884 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0218ca6e-3c4b-4f3c-8fc6-acea79f12a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.650035 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Volume 01e091d3-23ed-4dd3-9ff0-6322c665775f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e091d3-23ed-4dd3-9ff0-6322c665775f', 'volume_size': 1} Mar 26 20:55:54.650727 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] creating volume 'volume-01e091d3-23ed-4dd3-9ff0-6322c665775f' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:55:54.653831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:55:54.842405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:55:54.843192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:55:54.847136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0218ca6e-3c4b-4f3c-8fc6-acea79f12a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e091d3-23ed-4dd3-9ff0-6322c665775f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:54.852060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680f89c9-ae2a-4dcd-becd-15d6d9052210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:54.886098 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Volume volume-01e091d3-23ed-4dd3-9ff0-6322c665775f (01e091d3-23ed-4dd3-9ff0-6322c665775f): created successfully Mar 26 20:55:54.923972 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680f89c9-ae2a-4dcd-becd-15d6d9052210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:55.004864 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (1e7a3a8e-0733-442a-adb9-50ea6d1c0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:55.036400 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-df5e36ad-6626-4dd7-948d-55117209bd2f tempest-VolumesTestJSON-1881710145 None] Created volume successfully. Mar 26 20:55:56.405527 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:55:56.510695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (da55426c-2248-467f-b56d-78b355b389f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:56.526945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ea1f38-45fb-49ec-8866-b07aca067351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.567068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ea1f38-45fb-49ec-8866-b07aca067351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1107737114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f974eea-182a-4b76-8962-63e03dfbfe94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb6fc427c1a34e1e82749e6035a27b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:55:56Z,use_quota=True,user_id='890dc80d77a04a8a8a3f2e0194f06ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.580366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dc3b38-f4d7-4d36-9e8d-c7e831722245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.593195 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dc3b38-f4d7-4d36-9e8d-c7e831722245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.604605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f267a02a-89c1-4ef4-b5e3-4f9fb77c78da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.616533 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f267a02a-89c1-4ef4-b5e3-4f9fb77c78da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f974eea-182a-4b76-8962-63e03dfbfe94', 'volume_name': 'volume-5f974eea-182a-4b76-8962-63e03dfbfe94', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.627758 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb82dd6-fe5d-41e1-941a-bf01ade9a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.635551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb82dd6-fe5d-41e1-941a-bf01ade9a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.655783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2ff287-160f-44be-8372-4cb7d089e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.657551 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Volume 5f974eea-182a-4b76-8962-63e03dfbfe94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f974eea-182a-4b76-8962-63e03dfbfe94', 'volume_size': 1} Mar 26 20:55:56.658114 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] creating volume 'volume-5f974eea-182a-4b76-8962-63e03dfbfe94' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:55:56.658952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:55:56.848128 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:55:56.848418 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:55:56.855304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2ff287-160f-44be-8372-4cb7d089e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f974eea-182a-4b76-8962-63e03dfbfe94', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.869989 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa721e08-6701-4ffd-9029-c7e75a653230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:55:56.902799 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Volume volume-5f974eea-182a-4b76-8962-63e03dfbfe94 (5f974eea-182a-4b76-8962-63e03dfbfe94): created successfully Mar 26 20:55:56.907661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa721e08-6701-4ffd-9029-c7e75a653230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:55:56.922719 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Flow 'volume_create_manager' (da55426c-2248-467f-b56d-78b355b389f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:55:56.963353 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a0d23e37-d13a-4cd0-a0c4-a71cbd5ece2f tempest-VolumesTestJSON-1881710145 None] Created volume successfully. Mar 26 20:55:58.128525 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:55:58.132299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:55:58.243719 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:55:58.326030 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:56:00.711199 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-5f974eea-182a-4b76-8962-63e03dfbfe94-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:56:00.780168 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:00.890055 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:56:00.891036 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Volume volume-5f974eea-182a-4b76-8962-63e03dfbfe94 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:56:00.912757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] deleting rbd volume volume-5f974eea-182a-4b76-8962-63e03dfbfe94 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:56:01.466525 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Created reservations ['4fe97347-5dfd-4f3e-9c3e-a0c32145e7f4', 'cb9b738b-252d-4a34-8854-cf105abd3ef6', 'd6039bef-13dd-4312-96c1-a099240ef59a', '1ddede8d-88dd-415b-b16a-3eac7c1f54cd'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:56:01.605648 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:01.709735 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:01.790632 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:56:01.795874 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Deleted volume successfully. Mar 26 20:56:01.819826 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d2d5ef2a-33ce-4142-9ef0-7fe16da07e33 tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-5f974eea-182a-4b76-8962-63e03dfbfe94-delete_volume'" released by "delete_volume" :: held 1.106s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:56:01.937091 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-01e091d3-23ed-4dd3-9ff0-6322c665775f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:56:02.084563 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:02.199780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:56:02.200364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Volume volume-01e091d3-23ed-4dd3-9ff0-6322c665775f is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:56:02.215032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] deleting rbd volume volume-01e091d3-23ed-4dd3-9ff0-6322c665775f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:56:02.758818 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Created reservations ['6e391b00-c437-48a6-813e-667194143523', 'cb762bba-34da-49f9-ac33-5646eb3bcb81', 'bc052c26-216c-454d-b239-9c34c00391e6', '86178bd4-12c3-47e0-8969-888015841080'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:56:02.854911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:02.914646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:02.993044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:56:02.998171 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Deleted volume successfully. Mar 26 20:56:03.018801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7e9d6227-0fbd-4574-b551-942c8fb17ccf tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-01e091d3-23ed-4dd3-9ff0-6322c665775f-delete_volume'" released by "delete_volume" :: held 1.082s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:56:03.268872 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-3751315c-9dc4-4005-8125-589442d464ee-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:56:03.334776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:03.458100 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:56:03.458531 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Volume volume-3751315c-9dc4-4005-8125-589442d464ee is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:56:03.473181 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] deleting rbd volume volume-3751315c-9dc4-4005-8125-589442d464ee {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:56:04.030271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Created reservations ['3532770b-0b16-4591-a996-2173ff48f9db', '4043da66-db5e-46d6-b73c-b3039fa149e8', '8262498a-2162-436f-9b07-956a179caba4', '41cc699a-9c3f-4b77-bf76-9ff2e0f06ee4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:56:04.123726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:04.219862 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:04.293476 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:56:04.297905 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Deleted volume successfully. Mar 26 20:56:04.327304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-51d14f57-64ec-4a99-95a0-af62ec425c3b tempest-VolumesTestJSON-1881710145 None] Lock "b'cinder-3751315c-9dc4-4005-8125-589442d464ee-delete_volume'" released by "delete_volume" :: held 1.059s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:56:29.713464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:56:29.751810 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Flow 'volume_create_manager' (e2474319-73eb-46f0-96e0-e167350e8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:56:29.770098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32106c5-bd91-4256-a14d-8c457f1d9319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:29.800868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32106c5-bd91-4256-a14d-8c457f1d9319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2045244302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e51fbb6333452b84c0c77d29b423b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:56:30Z,use_quota=True,user_id='57e806dbaedc49e395b7d6b374ca2fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:29.815642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16a8277-6d21-492d-8e20-9f061f880546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:29.819031 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16a8277-6d21-492d-8e20-9f061f880546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:29.834275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccf96e-8d83-4b9a-affd-ca60d88615fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:29.838623 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ccf96e-8d83-4b9a-affd-ca60d88615fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'volume_name': 'volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:29.853272 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7825a4-996e-4070-988d-bed32310cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:29.857372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7825a4-996e-4070-988d-bed32310cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:29.862730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d452f6-d509-4ff1-b83f-075c97ae49e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:29.864104 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Volume ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'volume_size': 1} Mar 26 20:56:29.864689 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] creating volume 'volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:56:29.865910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:30.000194 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:56:30.000710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:56:30.011476 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d452f6-d509-4ff1-b83f-075c97ae49e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:30.024811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0411ab4b-53f8-4aa1-a779-b5649ae3da64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:56:30.069624 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Volume volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75 (ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75): created successfully Mar 26 20:56:30.075827 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0411ab4b-53f8-4aa1-a779-b5649ae3da64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:56:30.134125 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Flow 'volume_create_manager' (e2474319-73eb-46f0-96e0-e167350e8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:56:30.161805 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-627732b4-627b-47ab-b424-1b467778dc3b tempest-AttachSCSIVolumeTestJSON-1163101248 None] Created volume successfully. Mar 26 20:56:31.567769 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-eace188b-beaf-4ffe-a79f-381c8641ab46 req-efdbe7c4-9824-41d4-a9fd-0dbc4c7d9e5f tempest-AttachSCSIVolumeTestJSON-1163101248 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:56:33.328454 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-eace188b-beaf-4ffe-a79f-381c8641ab46 req-efdbe7c4-9824-41d4-a9fd-0dbc4c7d9e5f tempest-AttachSCSIVolumeTestJSON-1163101248 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.760s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:56:33.329310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-eace188b-beaf-4ffe-a79f-381c8641ab46 req-efdbe7c4-9824-41d4-a9fd-0dbc4c7d9e5f tempest-AttachSCSIVolumeTestJSON-1163101248 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:56:33.376527 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-eace188b-beaf-4ffe-a79f-381c8641ab46 req-efdbe7c4-9824-41d4-a9fd-0dbc4c7d9e5f tempest-AttachSCSIVolumeTestJSON-1163101248 None] Connection info returned from driver {'name': 'volumes/volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '101e8618-d129-49eb-aaf4-ce37f69dd0a9'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:56:33.438247 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-eace188b-beaf-4ffe-a79f-381c8641ab46 req-efdbe7c4-9824-41d4-a9fd-0dbc4c7d9e5f tempest-AttachSCSIVolumeTestJSON-1163101248 None] attachment_update completed successfully. Mar 26 20:56:37.012672 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 req-29fb336f-cca4-4f01-ad17-9d65cbb164a8 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Terminate volume connection completed successfully. Mar 26 20:56:37.012672 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 req-29fb336f-cca4-4f01-ad17-9d65cbb164a8 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Deleting attachment 101e8618-d129-49eb-aaf4-ce37f69dd0a9. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 20:56:54.323298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Lock "b'cinder-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:56:54.389801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:54.486368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 20:56:54.486871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Volume volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:56:54.503583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] deleting rbd volume volume-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 20:56:55.027470 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Created reservations ['98d3c214-82c7-4ff6-9434-233664f4ae53', 'e3e811e7-801b-4d4d-abd7-ff07a53fd531', 'c9cf483d-99ae-4849-ac2c-451a9b5ca05a', '1a1be0b9-d1af-4dea-b1f0-74886304a924'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 20:56:55.093733 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:55.155230 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:55.265456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:56:55.274546 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Deleted volume successfully. Mar 26 20:56:55.298302 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a2b0b3ac-4225-4e03-9995-d766972a3295 tempest-AttachSCSIVolumeTestJSON-1163101248 None] Lock "b'cinder-ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75-delete_volume'" released by "delete_volume" :: held 0.975s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:56:58.131689 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:56:58.133260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:58.216040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:56:58.310210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:57:58.129349 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:57:58.130068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:57:58.215991 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:57:58.293630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:58:58.126706 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:58:58.128293 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:58:58.183910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:58:58.250731 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:59:08.525128 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:59:08.554846 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Flow 'volume_create_manager' (0c6f7d4e-cc21-4138-9fdf-4acdf55bf4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:08.563054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b54701-026e-48e6-95e0-e8d82c71ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:08.582671 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b54701-026e-48e6-95e0-e8d82c71ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1492038213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5592d5c0-89ac-4148-a31c-07af1fa34169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='586533ed0cf646c2945f68477b651e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:59:08Z,use_quota=True,user_id='791eb951b71e493c82ce921d1f8f4174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:08.589193 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09082357-3036-4e8f-adc1-5c76f4e616bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:08.594741 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09082357-3036-4e8f-adc1-5c76f4e616bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:08.601925 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046bc218-4c1a-4d1e-b4f5-47d8b2212a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:08.742173 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046bc218-4c1a-4d1e-b4f5-47d8b2212a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5592d5c0-89ac-4148-a31c-07af1fa34169', 'volume_name': 'volume-5592d5c0-89ac-4148-a31c-07af1fa34169', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:08.749571 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81a397f-9d5b-4de3-81c7-05a57f7c7c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:08.757873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81a397f-9d5b-4de3-81c7-05a57f7c7c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:08.763251 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c5918-6d7c-49d7-ba07-f94c6301fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:08.765064 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Volume 5592d5c0-89ac-4148-a31c-07af1fa34169: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5592d5c0-89ac-4148-a31c-07af1fa34169', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 20:59:08.765783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Cloning 5592d5c0-89ac-4148-a31c-07af1fa34169 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 20:59:08.779691 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 20:59:08.816079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 20, 59, 8, 805970)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 20:59:08.816626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 20:59:08.817041 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 20:59:08.826002 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 20:59:08.828896 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 20:59:08.841382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 20, 59, 8, 837299)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 20:59:08.842478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 20:59:08.843076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 20:59:08.871842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:59:08.992233 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] creating snapshot='volume-5592d5c0-89ac-4148-a31c-07af1fa34169.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 20:59:09.519532 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-5592d5c0-89ac-4148-a31c-07af1fa34169.clone_snap' to 'volume-5592d5c0-89ac-4148-a31c-07af1fa34169' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 20:59:09.716433 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 20:59:09.718978 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:59:09.719533 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:59:09.785046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 20:59:09.785886 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Marking volume 5592d5c0-89ac-4148-a31c-07af1fa34169 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 20:59:09.799817 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 5592d5c0-89ac-4148-a31c-07af1fa34169. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 20:59:09.801083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Creating volume glance metadata for volume 5592d5c0-89ac-4148-a31c-07af1fa34169 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 20:59:09.887659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c5918-6d7c-49d7-ba07-f94c6301fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5592d5c0-89ac-4148-a31c-07af1fa34169', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:09.893436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c595f1d-6729-4897-953c-f437a3715cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:09.905072 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Volume volume-5592d5c0-89ac-4148-a31c-07af1fa34169 (5592d5c0-89ac-4148-a31c-07af1fa34169): created successfully Mar 26 20:59:09.911550 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c595f1d-6729-4897-953c-f437a3715cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:09.925866 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Flow 'volume_create_manager' (0c6f7d4e-cc21-4138-9fdf-4acdf55bf4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:09.937804 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3083cb25-afe4-4c79-802d-6ae05adcd2eb tempest-ServersTestBootFromVolume-299370577 None] Created volume successfully. Mar 26 20:59:14.436442 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 req-66cc269f-a711-48e3-b812-be73585793e1 tempest-ServersTestBootFromVolume-299370577 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:59:15.197470 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 req-66cc269f-a711-48e3-b812-be73585793e1 tempest-ServersTestBootFromVolume-299370577 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.761s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:59:15.198578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 req-66cc269f-a711-48e3-b812-be73585793e1 tempest-ServersTestBootFromVolume-299370577 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5592d5c0-89ac-4148-a31c-07af1fa34169', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '5592d5c0-89ac-4148-a31c-07af1fa34169', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 20:59:15.222578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 req-66cc269f-a711-48e3-b812-be73585793e1 tempest-ServersTestBootFromVolume-299370577 None] Connection info returned from driver {'name': 'volumes/volume-5592d5c0-89ac-4148-a31c-07af1fa34169', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5592d5c0-89ac-4148-a31c-07af1fa34169', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a508a2ac-ce38-4ccd-9efe-0887f0444020'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 20:59:15.276475 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 req-66cc269f-a711-48e3-b812-be73585793e1 tempest-ServersTestBootFromVolume-299370577 None] attachment_update completed successfully. Mar 26 20:59:29.163836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:59:29.184724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Flow 'volume_create_manager' (72924af6-8485-4756-a94d-8ca47bf6f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:29.191560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b447ea77-1741-428a-9a00-02956acc2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.212544 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b447ea77-1741-428a-9a00-02956acc2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-238108229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36e8e8ba-7a91-417d-bf04-163b8cd8d805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0b12b0e8843e99f5aac63876e13fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:59:29Z,use_quota=True,user_id='3cb495ec547743d38a7502110a166b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.220119 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bbfbe1-c019-46f2-8cd5-24543be2c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.226026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bbfbe1-c019-46f2-8cd5-24543be2c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.233677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38eaf8-03ef-4ba8-8de1-e587715d3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.238904 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38eaf8-03ef-4ba8-8de1-e587715d3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e8e8ba-7a91-417d-bf04-163b8cd8d805', 'volume_name': 'volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.246211 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b035992-1a7b-450b-8949-bfd9f1fc73e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.251155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b035992-1a7b-450b-8949-bfd9f1fc73e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.257406 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08691609-19ff-457c-a57b-463e4362000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.259262 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume 36e8e8ba-7a91-417d-bf04-163b8cd8d805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805', 'volume_size': 1} Mar 26 20:59:29.260095 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] creating volume 'volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:59:29.261355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:59:29.377037 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:59:29.377816 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:59:29.382690 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08691609-19ff-457c-a57b-463e4362000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.388636 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20733945-0074-42f2-8906-b797e6b582c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:29.405890 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805 (36e8e8ba-7a91-417d-bf04-163b8cd8d805): created successfully Mar 26 20:59:29.412679 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20733945-0074-42f2-8906-b797e6b582c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:29.429849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Flow 'volume_create_manager' (72924af6-8485-4756-a94d-8ca47bf6f97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:29.443167 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-69009bba-8abc-4ae9-8416-f8cb934d2def tempest-ServerRescueNegativeTestJSON-1836208909 None] Created volume successfully. Mar 26 20:59:57.723669 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 20:59:57.769385 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Flow 'volume_create_manager' (2658b4a7-ed9a-4927-8eec-724d2b788099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:57.785843 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad0c01-1d0f-4aa8-ac51-c6242886b8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:57.822251 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad0c01-1d0f-4aa8-ac51-c6242886b8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T20:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-542756897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e8c875b-50fe-4f77-bc0e-a4f6256e714d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0b12b0e8843e99f5aac63876e13fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T20:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T20:59:58Z,use_quota=True,user_id='3cb495ec547743d38a7502110a166b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:57.830925 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facce865-7155-4699-a856-191cdb939548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:57.842112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facce865-7155-4699-a856-191cdb939548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:57.866481 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e24568-a4e4-4165-a373-9241fe7ac501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:57.913800 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e24568-a4e4-4165-a373-9241fe7ac501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'volume_name': 'volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:57.965465 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63fa1bf-2472-44e7-8dd8-db554b8168e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:57.991774 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63fa1bf-2472-44e7-8dd8-db554b8168e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:58.055010 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcc86c0-ad67-471a-b0fc-6cf1f39cf6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:58.066453 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume 7e8c875b-50fe-4f77-bc0e-a4f6256e714d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'volume_size': 1} Mar 26 20:59:58.067501 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] creating volume 'volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 20:59:58.069834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:59:58.175641 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 20:59:58.178335 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:59:58.279759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 20:59:58.356486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 20:59:58.362084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 20:59:58.362958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 20:59:58.370209 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcc86c0-ad67-471a-b0fc-6cf1f39cf6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:58.384226 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f76b3-d1c5-4cee-84cc-bd488e98182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 20:59:58.408749 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d (7e8c875b-50fe-4f77-bc0e-a4f6256e714d): created successfully Mar 26 20:59:58.412683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f76b3-d1c5-4cee-84cc-bd488e98182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 20:59:58.423367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Flow 'volume_create_manager' (2658b4a7-ed9a-4927-8eec-724d2b788099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 20:59:58.450180 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-07f0480c-87ef-49f9-8b96-0046fb9767ed tempest-ServerRescueNegativeTestJSON-1836208909 None] Created volume successfully. Mar 26 21:00:58.176777 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:00:58.178260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:00:58.247038 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:00:58.315994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:00:59.618948 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6e470676-6644-4278-bfdc-75b2eb58211a req-eafca83d-76ab-4728-845e-9df4a7194842 tempest-ServersTestBootFromVolume-299370577 None] Terminate volume connection completed successfully. Mar 26 21:00:59.620325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-6e470676-6644-4278-bfdc-75b2eb58211a req-eafca83d-76ab-4728-845e-9df4a7194842 tempest-ServersTestBootFromVolume-299370577 None] Deleting attachment a508a2ac-ce38-4ccd-9efe-0887f0444020. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:00:59.857545 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] Lock "b'cinder-5592d5c0-89ac-4148-a31c-07af1fa34169-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:00:59.957849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:00.093147 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:01:00.107728 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] deleting rbd volume volume-5592d5c0-89ac-4148-a31c-07af1fa34169 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:01:00.752943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:01:00.787222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] deleting parent snapshot volume-5592d5c0-89ac-4148-a31c-07af1fa34169.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:01:01.695274 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] Created reservations ['d6a07b4b-935e-4f1a-a3b2-e1139d8e5199', '3b5b0be9-15ac-4461-863d-bfa5605d8738', 'e960a2bd-65e2-4d31-9f34-c98f110857ac', 'dd8efe3d-1f50-4dfa-8986-50f54c840e3d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:01:01.781910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:01.899565 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:01.979159 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:01:01.983645 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] Deleted volume successfully. Mar 26 21:01:02.028298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-6e470676-6644-4278-bfdc-75b2eb58211a req-f91934ba-db24-4583-a1bf-a4180b4208bd tempest-ServersTestBootFromVolume-299370577 None] Lock "b'cinder-5592d5c0-89ac-4148-a31c-07af1fa34169-delete_volume'" released by "delete_volume" :: held 2.171s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:01:02.761672 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 req-b3bcdd61-11f8-4566-ac95-e27dc1639d90 tempest-ServerRescueNegativeTestJSON-1836208909 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:01:03.601174 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 req-b3bcdd61-11f8-4566-ac95-e27dc1639d90 tempest-ServerRescueNegativeTestJSON-1836208909 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.837s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:01:03.603372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 req-b3bcdd61-11f8-4566-ac95-e27dc1639d90 tempest-ServerRescueNegativeTestJSON-1836208909 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:01:03.663087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 req-b3bcdd61-11f8-4566-ac95-e27dc1639d90 tempest-ServerRescueNegativeTestJSON-1836208909 None] Connection info returned from driver {'name': 'volumes/volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7e8c875b-50fe-4f77-bc0e-a4f6256e714d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1334edbe-723f-4f02-ab64-9fbe8510853a'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:01:03.743857 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 req-b3bcdd61-11f8-4566-ac95-e27dc1639d90 tempest-ServerRescueNegativeTestJSON-1836208909 None] attachment_update completed successfully. Mar 26 21:01:34.835558 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:01:34.891307 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (8c3fa462-6390-400b-b51b-05878e2cdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:34.911164 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653b86fe-bd16-4b77-85a9-a59a74758bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:34.949965 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653b86fe-bd16-4b77-85a9-a59a74758bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-92725281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d40ca192-1678-4361-83fa-186b54864c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9643f439b26e41cda482b9533143d636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:01:35Z,use_quota=True,user_id='87a1de01e7de440d86084c1b5b5aede4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:34.970609 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eed35a-7c30-4d79-addf-b2652dcd1424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:34.978142 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eed35a-7c30-4d79-addf-b2652dcd1424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:34.994824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c34bc2-1b26-45ea-8a61-319b48f3cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:35.136523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c34bc2-1b26-45ea-8a61-319b48f3cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd40ca192-1678-4361-83fa-186b54864c59', 'volume_name': 'volume-d40ca192-1678-4361-83fa-186b54864c59', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:35.143578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513b86f7-8a26-4da9-bb16-2f749cd0afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:35.148116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513b86f7-8a26-4da9-bb16-2f749cd0afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:35.153726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd059d-3baf-4d48-acca-5c00fd1fa162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:35.155211 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Volume d40ca192-1678-4361-83fa-186b54864c59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d40ca192-1678-4361-83fa-186b54864c59', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:01:35.156302 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Cloning d40ca192-1678-4361-83fa-186b54864c59 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:01:35.167144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:01:35.183867 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 1, 35, 173253)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:01:35.185198 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:01:35.185861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:01:35.192108 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:01:35.197252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:01:35.214232 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 1, 35, 206797)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:01:35.215824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:01:35.216834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:01:35.245923 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:35.401168 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] creating snapshot='volume-d40ca192-1678-4361-83fa-186b54864c59.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:01:36.434787 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-d40ca192-1678-4361-83fa-186b54864c59.clone_snap' to 'volume-d40ca192-1678-4361-83fa-186b54864c59' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:01:36.669150 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:01:36.670455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:01:36.671034 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:01:36.715257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:01:36.716260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Marking volume d40ca192-1678-4361-83fa-186b54864c59 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:01:36.730557 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to d40ca192-1678-4361-83fa-186b54864c59. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:01:36.731226 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Creating volume glance metadata for volume d40ca192-1678-4361-83fa-186b54864c59 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:01:36.981930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dd059d-3baf-4d48-acca-5c00fd1fa162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40ca192-1678-4361-83fa-186b54864c59', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:36.997019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42481011-b397-4259-9299-613a71a49594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:37.028142 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-d40ca192-1678-4361-83fa-186b54864c59 (d40ca192-1678-4361-83fa-186b54864c59): created successfully Mar 26 21:01:37.034760 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42481011-b397-4259-9299-613a71a49594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:37.062698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (8c3fa462-6390-400b-b51b-05878e2cdad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:37.085339 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-814e6da7-260c-4589-af0f-e30c8aa77362 tempest-TaggedBootDevicesTest-1972550485 None] Created volume successfully. Mar 26 21:01:38.990441 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:01:39.072068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (a4af5ce6-ee03-4cf2-a613-e01f84ecf300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:39.093137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ee978-9419-4b6d-b657-03b453372021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.124479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ee978-9419-4b6d-b657-03b453372021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1853321726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9643f439b26e41cda482b9533143d636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:01:39Z,use_quota=True,user_id='87a1de01e7de440d86084c1b5b5aede4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.140368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714c18e-4ab9-40b5-81d1-6b9de1c98483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.147412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714c18e-4ab9-40b5-81d1-6b9de1c98483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.168985 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ff2be9-96f5-4ccc-9d23-276412e84e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.198151 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ff2be9-96f5-4ccc-9d23-276412e84e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'volume_name': 'volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.207014 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce33cfe-91a6-4b5b-b182-047f4833da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.229676 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce33cfe-91a6-4b5b-b182-047f4833da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.245721 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe6631-b198-4b6d-a220-15045dbaf7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.250236 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Volume f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'volume_size': 1} Mar 26 21:01:39.252746 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] creating volume 'volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:01:39.256155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:39.429167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:01:39.429731 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:01:39.433922 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe6631-b198-4b6d-a220-15045dbaf7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.438981 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5940321c-ee8c-44f5-8681-584dc4e52359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:39.478203 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6 (f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6): created successfully Mar 26 21:01:39.483818 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5940321c-ee8c-44f5-8681-584dc4e52359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:39.498754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (a4af5ce6-ee03-4cf2-a613-e01f84ecf300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:39.524773 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b1221e3e-9b37-44b0-a476-c2f04a175d91 tempest-TaggedBootDevicesTest-1972550485 None] Created volume successfully. Mar 26 21:01:40.897095 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:01:40.956011 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (6c1532ac-501b-4277-be62-4311e0fa42e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:40.975993 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930cb94f-4a29-4796-8a2d-6becd5d1c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.039759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930cb94f-4a29-4796-8a2d-6becd5d1c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1502862885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=65bed174-5bd9-4361-8a87-20e4a95b8976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9643f439b26e41cda482b9533143d636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:01:41Z,use_quota=True,user_id='87a1de01e7de440d86084c1b5b5aede4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.048932 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d0eada-51bb-4eee-87e1-9697a959941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.058843 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d0eada-51bb-4eee-87e1-9697a959941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.070880 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfed80d-bb90-4651-869a-868e3b8e64c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.084318 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfed80d-bb90-4651-869a-868e3b8e64c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bed174-5bd9-4361-8a87-20e4a95b8976', 'volume_name': 'volume-65bed174-5bd9-4361-8a87-20e4a95b8976', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.122320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579ca31e-4343-4ed2-a64b-490527d3e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.131007 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579ca31e-4343-4ed2-a64b-490527d3e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.161475 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060e30a-66c2-427d-a023-abb02ef08b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.164204 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Volume 65bed174-5bd9-4361-8a87-20e4a95b8976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bed174-5bd9-4361-8a87-20e4a95b8976', 'volume_size': 1} Mar 26 21:01:41.164615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] creating volume 'volume-65bed174-5bd9-4361-8a87-20e4a95b8976' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:01:41.165325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:41.333149 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:01:41.333334 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:01:41.339210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060e30a-66c2-427d-a023-abb02ef08b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bed174-5bd9-4361-8a87-20e4a95b8976', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.356654 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b33b60-1790-48d2-af2c-50e0c60c7f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:01:41.393883 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-65bed174-5bd9-4361-8a87-20e4a95b8976 (65bed174-5bd9-4361-8a87-20e4a95b8976): created successfully Mar 26 21:01:41.399692 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b33b60-1790-48d2-af2c-50e0c60c7f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:01:41.432196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Flow 'volume_create_manager' (6c1532ac-501b-4277-be62-4311e0fa42e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:01:41.458887 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b4b22200-275f-42d3-88fb-06da05bfccb7 tempest-TaggedBootDevicesTest-1972550485 None] Created volume successfully. Mar 26 21:01:58.173104 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:01:58.174366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:58.243376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:01:58.352160 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:02:05.356300 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 req-ddd802c7-b447-4e4c-9821-cacd1fcdba7c tempest-ServerRescueNegativeTestJSON-1836208909 None] Terminate volume connection completed successfully. Mar 26 21:02:05.358718 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 req-ddd802c7-b447-4e4c-9821-cacd1fcdba7c tempest-ServerRescueNegativeTestJSON-1836208909 None] Deleting attachment 1334edbe-723f-4f02-ab64-9fbe8510853a. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:02:07.904631 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-b24614a0-f682-4419-b38c-2705dfb51eee tempest-TaggedBootDevicesTest-1972550485 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:02:09.284473 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-b24614a0-f682-4419-b38c-2705dfb51eee tempest-TaggedBootDevicesTest-1972550485 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.379s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:02:09.285137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-b24614a0-f682-4419-b38c-2705dfb51eee tempest-TaggedBootDevicesTest-1972550485 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d40ca192-1678-4361-83fa-186b54864c59', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'd40ca192-1678-4361-83fa-186b54864c59', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:02:09.347714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-b24614a0-f682-4419-b38c-2705dfb51eee tempest-TaggedBootDevicesTest-1972550485 None] Connection info returned from driver {'name': 'volumes/volume-d40ca192-1678-4361-83fa-186b54864c59', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd40ca192-1678-4361-83fa-186b54864c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9df89e20-ad7d-45e0-8f0f-1c9a0ab797b0'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:02:09.427011 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-b24614a0-f682-4419-b38c-2705dfb51eee tempest-TaggedBootDevicesTest-1972550485 None] attachment_update completed successfully. Mar 26 21:02:09.847328 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-8360f566-827c-4291-9bdc-e293862929be tempest-TaggedBootDevicesTest-1972550485 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:02:11.173791 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-8360f566-827c-4291-9bdc-e293862929be tempest-TaggedBootDevicesTest-1972550485 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.326s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:02:11.175379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-8360f566-827c-4291-9bdc-e293862929be tempest-TaggedBootDevicesTest-1972550485 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:02:11.221608 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-8360f566-827c-4291-9bdc-e293862929be tempest-TaggedBootDevicesTest-1972550485 None] Connection info returned from driver {'name': 'volumes/volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c1708993-fe7c-49b8-84e2-2e3cff4fd54a'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:02:11.361070 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-8360f566-827c-4291-9bdc-e293862929be tempest-TaggedBootDevicesTest-1972550485 None] attachment_update completed successfully. Mar 26 21:02:11.980736 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-06141e26-7c4f-4b1f-bad8-73d86e103b59 tempest-TaggedBootDevicesTest-1972550485 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:02:12.860820 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-06141e26-7c4f-4b1f-bad8-73d86e103b59 tempest-TaggedBootDevicesTest-1972550485 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.882s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:02:12.861632 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-06141e26-7c4f-4b1f-bad8-73d86e103b59 tempest-TaggedBootDevicesTest-1972550485 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-65bed174-5bd9-4361-8a87-20e4a95b8976', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '65bed174-5bd9-4361-8a87-20e4a95b8976', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:02:12.904668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-06141e26-7c4f-4b1f-bad8-73d86e103b59 tempest-TaggedBootDevicesTest-1972550485 None] Connection info returned from driver {'name': 'volumes/volume-65bed174-5bd9-4361-8a87-20e4a95b8976', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '65bed174-5bd9-4361-8a87-20e4a95b8976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cea42939-d6c0-48c8-9e59-80d5244450dd'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:02:12.994781 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-45c0498e-042e-49d6-b1c1-7075755de9ef req-06141e26-7c4f-4b1f-bad8-73d86e103b59 tempest-TaggedBootDevicesTest-1972550485 None] attachment_update completed successfully. Mar 26 21:02:24.135855 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Lock "b'cinder-7e8c875b-50fe-4f77-bc0e-a4f6256e714d-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:02:24.210703 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:24.356504 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:02:24.357933 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:02:24.364972 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] deleting rbd volume volume-7e8c875b-50fe-4f77-bc0e-a4f6256e714d {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:02:24.916087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Created reservations ['7cc4cae8-2751-48de-bc3f-2a6b37d802b8', '2f2b98dc-b65e-43e9-9319-e4bd2c7e7940', '93661109-c27c-4622-9566-f8f4ecf8b1c9', 'aa0af1f9-bba3-4440-a782-d078b4912541'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:02:25.035496 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:25.137813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:25.221590 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:02:25.237752 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Deleted volume successfully. Mar 26 21:02:25.275692 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a3e8a8d1-85f2-4df3-a6b7-bf11bba05077 tempest-ServerRescueNegativeTestJSON-1836208909 None] Lock "b'cinder-7e8c875b-50fe-4f77-bc0e-a4f6256e714d-delete_volume'" released by "delete_volume" :: held 1.140s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:02:25.449643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Lock "b'cinder-36e8e8ba-7a91-417d-bf04-163b8cd8d805-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:02:25.521114 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:25.664940 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:02:25.665469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Volume volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:02:25.688861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] deleting rbd volume volume-36e8e8ba-7a91-417d-bf04-163b8cd8d805 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:02:26.150218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Created reservations ['36fe7666-0fbb-4f2c-8642-69244fdc4e35', '02c0c4d3-fbc7-484b-8f00-82abc4abc7a3', 'a495ca01-d536-4584-9ff3-0c7239d2c81a', '6969339d-9ccc-4992-87ea-f56605628e74'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:02:26.304323 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:26.373765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:26.459968 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:02:26.466894 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Deleted volume successfully. Mar 26 21:02:26.490954 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ca41ddaf-da36-4b92-9413-59fb6476b54c tempest-ServerRescueNegativeTestJSON-1836208909 None] Lock "b'cinder-36e8e8ba-7a91-417d-bf04-163b8cd8d805-delete_volume'" released by "delete_volume" :: held 1.041s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:02:58.177286 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:02:58.178785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:58.257483 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:02:58.329376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:03:58.173405 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:03:58.174201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:03:58.219821 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:03:58.260084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:16.632640 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-35ccc4b4-a546-4461-b956-e3acb262036f tempest-GroupsTest-241137442 None] Group tempest-Group1-818361529: creating Mar 26 21:04:16.685490 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-35ccc4b4-a546-4461-b956-e3acb262036f tempest-GroupsTest-241137442 None] Group tempest-Group1-818361529: created successfully Mar 26 21:04:16.699283 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-35ccc4b4-a546-4461-b956-e3acb262036f tempest-GroupsTest-241137442 None] Create group completed successfully. Mar 26 21:04:18.212114 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-31e2bc8b-368b-4a55-804a-1e6e507c1bc4 tempest-GroupsTest-241137442 None] Group tempest-Group2-869473152: creating Mar 26 21:04:18.269769 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-31e2bc8b-368b-4a55-804a-1e6e507c1bc4 tempest-GroupsTest-241137442 None] Group tempest-Group2-869473152: created successfully Mar 26 21:04:18.283263 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-31e2bc8b-368b-4a55-804a-1e6e507c1bc4 tempest-GroupsTest-241137442 None] Create group completed successfully. Mar 26 21:04:20.132833 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:20.224329 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (fe843ddf-9754-4090-89ae-9e2a22c1acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:20.238326 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1129d8-5dd7-4ca9-9e03-f0703f4b1ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.293970 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1129d8-5dd7-4ca9-9e03-f0703f4b1ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-61151492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31f4494d-6c5f-4ab0-8154-8dc9a85f734e,host='ncdv-master-1@ceph#ceph',id=42a85604-56e5-45fd-8e67-0b8242b0cb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c678d2fcd49fcb6bd6822ebc67e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:20Z,use_quota=True,user_id='97a43d839ec24c08998b387efb4de196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc11215d-2350-4567-936b-471490639a0c),volume_type_id=cc11215d-2350-4567-936b-471490639a0c)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.309796 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81d028-93d0-4f6e-b1a0-7c3ddb80c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.316479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf81d028-93d0-4f6e-b1a0-7c3ddb80c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.325951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ef0fee-2ca7-4333-bd7d-d0cc5ce3af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.332047 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ef0fee-2ca7-4333-bd7d-d0cc5ce3af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a85604-56e5-45fd-8e67-0b8242b0cb6a', 'volume_name': 'volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.342138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be38c67f-3680-48e4-96bf-5b494c094f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.347096 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be38c67f-3680-48e4-96bf-5b494c094f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.354910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bff602-a5ac-433a-a3fa-21ba60d8c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.357210 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Volume 42a85604-56e5-45fd-8e67-0b8242b0cb6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a', 'volume_size': 1} Mar 26 21:04:20.358127 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] creating volume 'volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:20.360105 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:20.497246 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:20.498015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:20.502158 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bff602-a5ac-433a-a3fa-21ba60d8c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.507240 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4cc1af-c382-4d2d-919f-8ae860f15129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:20.527041 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Volume volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a (42a85604-56e5-45fd-8e67-0b8242b0cb6a): created successfully Mar 26 21:04:20.544749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4cc1af-c382-4d2d-919f-8ae860f15129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:20.560787 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (fe843ddf-9754-4090-89ae-9e2a22c1acdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:20.579897 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3b4cb340-1df3-431f-96a1-013a0c995e32 tempest-GroupsTest-241137442 None] Created volume successfully. Mar 26 21:04:22.079316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:22.159005 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Flow 'volume_create_manager' (7a23781b-2d4d-46d6-81cd-1a50865f4188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:22.170727 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2a9523-cda2-4e30-ab14-508c6ed8c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.231717 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2a9523-cda2-4e30-ab14-508c6ed8c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-965960989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=575bb058-c5ae-4a01-831b-e61c0faaa551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a748aa42d5c4f55bd7d2d86838ff112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:22Z,use_quota=True,user_id='321431f1b82447d28c58e7d03fd20515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.238326 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6a3a1b-fb00-4f9b-8250-2da4583dd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.252806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6a3a1b-fb00-4f9b-8250-2da4583dd513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.260870 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376e7e9-cd93-4685-b91d-aa46302718cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.266979 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376e7e9-cd93-4685-b91d-aa46302718cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575bb058-c5ae-4a01-831b-e61c0faaa551', 'volume_name': 'volume-575bb058-c5ae-4a01-831b-e61c0faaa551', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.273047 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e8c63-9a70-4202-acad-f446f0afa14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.278755 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e8c63-9a70-4202-acad-f446f0afa14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.285835 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bd63d-649c-48ba-be7e-3cf5221a733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.287971 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume 575bb058-c5ae-4a01-831b-e61c0faaa551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575bb058-c5ae-4a01-831b-e61c0faaa551', 'volume_size': 1} Mar 26 21:04:22.288673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] creating volume 'volume-575bb058-c5ae-4a01-831b-e61c0faaa551' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:22.290428 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:22.485630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:22.486077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:22.490456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017bd63d-649c-48ba-be7e-3cf5221a733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575bb058-c5ae-4a01-831b-e61c0faaa551', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.499198 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac63bf-a10a-42db-91e4-7d0eaef05472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:22.565991 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume volume-575bb058-c5ae-4a01-831b-e61c0faaa551 (575bb058-c5ae-4a01-831b-e61c0faaa551): created successfully Mar 26 21:04:22.576247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfac63bf-a10a-42db-91e4-7d0eaef05472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:22.589719 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Flow 'volume_create_manager' (7a23781b-2d4d-46d6-81cd-1a50865f4188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:22.666086 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:22.741016 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:04:22.741523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Volume volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:04:22.762226 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] deleting rbd volume volume-42a85604-56e5-45fd-8e67-0b8242b0cb6a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:04:22.763575 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-bf4133d0-1c23-4d29-9905-43f4eddd0723 tempest-AttachVolumeShelveTestJSON-1677154310 None] Created volume successfully. Mar 26 21:04:23.508494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Created reservations ['e7b01e32-e56a-4bd9-a1cb-3c75b5e83ac8'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:23.539729 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-65359979 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-65359979, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:04:23.540860 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-65359979 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-65359979, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:04:23.564549 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Created reservations ['2bd6aeea-f9e0-4458-b269-7a66d1ba74f5', 'd1860c03-1422-460e-945b-54ae509989f5', 'd53c4ccc-7889-47a0-845b-d9ca67ef02ab', '6eca7b27-cffe-41f6-b7e3-f9e9fa8f0326'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:23.736626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:23.811575 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:23.894519 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:23.906330 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ef20f759-a7e0-44cd-93f3-423dc95d638b tempest-GroupsTest-241137442 None] Delete group completed successfully. Mar 26 21:04:24.206736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8613a8dc-8dbb-4c68-a6e2-d3b9d2e3fba1 tempest-GroupsTest-241137442 None] Created reservations ['9962652c-135f-43cd-a950-e2440a80d1f4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:24.266943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8613a8dc-8dbb-4c68-a6e2-d3b9d2e3fba1 tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:24.376953 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8613a8dc-8dbb-4c68-a6e2-d3b9d2e3fba1 tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:24.436654 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-8613a8dc-8dbb-4c68-a6e2-d3b9d2e3fba1 tempest-GroupsTest-241137442 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:24.445953 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8613a8dc-8dbb-4c68-a6e2-d3b9d2e3fba1 tempest-GroupsTest-241137442 None] Delete group completed successfully. Mar 26 21:04:26.037477 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dd9029de-b484-4e08-a371-5ec46acf3804 tempest-GroupsTest-241137442 None] Group tempest-GroupsTest-Group-989823646: creating Mar 26 21:04:26.079102 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dd9029de-b484-4e08-a371-5ec46acf3804 tempest-GroupsTest-241137442 None] Group tempest-GroupsTest-Group-989823646: created successfully Mar 26 21:04:26.095627 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dd9029de-b484-4e08-a371-5ec46acf3804 tempest-GroupsTest-241137442 None] Create group completed successfully. Mar 26 21:04:27.678615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:27.734707 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (b7bd4ce7-00f0-4911-900e-fb162be89312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:27.752481 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7695b5d8-f2fd-485d-9449-1166c9f56020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:27.785952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7695b5d8-f2fd-485d-9449-1166c9f56020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-2113896034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=828df630-eb1a-4dd7-bb17-31e6f736dc9b,host='ncdv-master-1@ceph#ceph',id=e278eb8f-690c-46eb-942a-e4734f382c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c678d2fcd49fcb6bd6822ebc67e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:28Z,use_quota=True,user_id='97a43d839ec24c08998b387efb4de196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678b686c-6992-42ed-b37b-1c58f28240a7),volume_type_id=678b686c-6992-42ed-b37b-1c58f28240a7)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:27.801422 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c8ba23-f71c-43aa-8744-c8fefcb99d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:27.805962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c8ba23-f71c-43aa-8744-c8fefcb99d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:27.828648 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7cc6bf-74f4-47f3-9da4-874db324b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:27.838238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7cc6bf-74f4-47f3-9da4-874db324b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e278eb8f-690c-46eb-942a-e4734f382c54', 'volume_name': 'volume-e278eb8f-690c-46eb-942a-e4734f382c54', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:27.863621 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20892283-bdfd-4da7-894b-c01c8c3571c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:27.874983 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20892283-bdfd-4da7-894b-c01c8c3571c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:27.887803 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b6a512-e3a7-478c-a8fb-e6ab63f63fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:27.888688 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Volume e278eb8f-690c-46eb-942a-e4734f382c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e278eb8f-690c-46eb-942a-e4734f382c54', 'volume_size': 1} Mar 26 21:04:27.889079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] creating volume 'volume-e278eb8f-690c-46eb-942a-e4734f382c54' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:27.889863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:27.984830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:27.985443 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:27.990261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b6a512-e3a7-478c-a8fb-e6ab63f63fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e278eb8f-690c-46eb-942a-e4734f382c54', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:27.996588 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3133ad57-8ef9-4732-9856-5b0d4669c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:28.011039 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Volume volume-e278eb8f-690c-46eb-942a-e4734f382c54 (e278eb8f-690c-46eb-942a-e4734f382c54): created successfully Mar 26 21:04:28.016176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3133ad57-8ef9-4732-9856-5b0d4669c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:28.022769 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (b7bd4ce7-00f0-4911-900e-fb162be89312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:28.039859 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4f663c3c-cafb-4ecf-93bd-1f191872a3d3 tempest-GroupsTest-241137442 None] Created volume successfully. Mar 26 21:04:29.636474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:29.712834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (7a839140-cf6e-4725-ac73-7f851fb99a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:29.734000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9637dc2-5c4e-4936-b29e-d96323adb37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:29.767784 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9637dc2-5c4e-4936-b29e-d96323adb37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1078499703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=828df630-eb1a-4dd7-bb17-31e6f736dc9b,host='ncdv-master-1@ceph#ceph',id=56caf7ae-6efb-4b05-87ce-be267cbf1e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c678d2fcd49fcb6bd6822ebc67e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:30Z,use_quota=True,user_id='97a43d839ec24c08998b387efb4de196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678b686c-6992-42ed-b37b-1c58f28240a7),volume_type_id=678b686c-6992-42ed-b37b-1c58f28240a7)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:29.782724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e872bf10-f4d3-4337-a336-b498c95f5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:29.795248 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e872bf10-f4d3-4337-a336-b498c95f5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:29.809063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670c7c3e-2292-4cab-961f-fecee40c863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:29.821974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670c7c3e-2292-4cab-961f-fecee40c863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56caf7ae-6efb-4b05-87ce-be267cbf1e39', 'volume_name': 'volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:29.835736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08166c06-1536-4691-80fa-cda0374670a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:29.850166 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08166c06-1536-4691-80fa-cda0374670a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:29.864050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a488ac0-5027-4f4c-97de-cf827c863038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:29.865526 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Volume 56caf7ae-6efb-4b05-87ce-be267cbf1e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39', 'volume_size': 1} Mar 26 21:04:29.872597 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] creating volume 'volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:29.873867 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:30.034809 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:30.035104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:30.046122 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a488ac0-5027-4f4c-97de-cf827c863038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:30.057608 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2049961-d95c-4a29-9a75-fe11ef3d578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:30.087289 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Volume volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39 (56caf7ae-6efb-4b05-87ce-be267cbf1e39): created successfully Mar 26 21:04:30.098493 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2049961-d95c-4a29-9a75-fe11ef3d578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:30.116550 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Flow 'volume_create_manager' (7a839140-cf6e-4725-ac73-7f851fb99a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:30.135949 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b6f65329-d404-4f68-9842-4b4970f5a8d8 tempest-GroupsTest-241137442 None] Created volume successfully. Mar 26 21:04:30.903411 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-082f0798-9e83-484b-b5cb-8b4ab430406e tempest-GroupsTest-241137442 None] Update group completed successfully. Mar 26 21:04:32.282470 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-03ea0c89-2c0a-46d1-a913-cfe760081e3b tempest-GroupsTest-241137442 None] Update group completed successfully. Mar 26 21:04:34.064380 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:34.201277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:04:34.201709 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Volume volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:04:34.232206 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] deleting rbd volume volume-56caf7ae-6efb-4b05-87ce-be267cbf1e39 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:04:34.401383 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:34.430754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (a360e7af-af67-4fd8-87bc-49487920aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:34.439614 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7726cc-f148-45f6-876d-b13426cd69d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.464298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7726cc-f148-45f6-876d-b13426cd69d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-667877455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5bc46c5-266e-44bc-843e-b5f8243721f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32df8b04107445c89edb0d809d87d6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:34Z,use_quota=True,user_id='8cab4cf432764bb487de9abc0f283898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.471639 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c5b01e-b977-4b46-865f-3c0d5c69a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.476574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c5b01e-b977-4b46-865f-3c0d5c69a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.482300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f746c-54b1-4530-92d6-b85eb01bb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.487207 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f746c-54b1-4530-92d6-b85eb01bb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bc46c5-266e-44bc-843e-b5f8243721f5', 'volume_name': 'volume-b5bc46c5-266e-44bc-843e-b5f8243721f5', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.492789 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f7bb2d-3955-4b13-a5b4-ef1db419feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.497813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f7bb2d-3955-4b13-a5b4-ef1db419feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.503695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb9010-381f-456b-937b-f08c7fa5b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.505104 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Volume b5bc46c5-266e-44bc-843e-b5f8243721f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bc46c5-266e-44bc-843e-b5f8243721f5', 'volume_size': 1} Mar 26 21:04:34.505768 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] creating volume 'volume-b5bc46c5-266e-44bc-843e-b5f8243721f5' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:34.506716 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:34.645946 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:34.646698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:34.651674 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb9010-381f-456b-937b-f08c7fa5b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bc46c5-266e-44bc-843e-b5f8243721f5', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.658675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6153ad29-30e6-4e6b-936d-497ed638770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:34.669914 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-b5bc46c5-266e-44bc-843e-b5f8243721f5 (b5bc46c5-266e-44bc-843e-b5f8243721f5): created successfully Mar 26 21:04:34.676425 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6153ad29-30e6-4e6b-936d-497ed638770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:34.701430 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (a360e7af-af67-4fd8-87bc-49487920aecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:34.717093 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-14513e80-c9a7-48a7-ae34-2f0a2c775727 tempest-AttachVolumeTestJSON-297536414 None] Created volume successfully. Mar 26 21:04:34.826742 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:34.925708 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:04:34.926659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Volume volume-e278eb8f-690c-46eb-942a-e4734f382c54 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:04:34.942209 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] deleting rbd volume volume-e278eb8f-690c-46eb-942a-e4734f382c54 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:04:35.655582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Created reservations ['5b545e0a-5032-4e16-ae79-31743dbd4d27'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:35.701607 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1787773746 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1787773746, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:04:35.705496 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1787773746 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1787773746, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:04:35.729252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Created reservations ['1baceb6c-1e5c-4300-b13d-d4ef208254ef', '4376c118-6004-4b19-949a-49fa4b59d074', 'ba373ba9-6bcf-4e08-8d1c-4f725c8caf74', '5f5a132e-9214-45b4-9b05-4195a424d278'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:35.889394 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Created reservations ['c801d0ce-a4c2-42fe-8f98-6ffacc977ad6', 'bfafdff5-655d-4e50-8bd8-9544051ccc57', 'e16b9263-f7c2-43a2-9729-885115bdd333', 'c72c8159-9f5e-4356-a152-2e5c6adcc9f7'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:36.086799 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:36.151657 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:36.207738 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:36.222941 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b0e4674b-951f-4579-aee3-c0716d9974bb tempest-GroupsTest-241137442 None] Delete group completed successfully. Mar 26 21:04:36.242570 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f492cc3c-a428-4920-a776-43159333a81c req-9536a96f-42b5-4f68-8198-ab406e6f3738 tempest-AttachVolumeTestJSON-297536414 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:04:37.393701 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f492cc3c-a428-4920-a776-43159333a81c req-9536a96f-42b5-4f68-8198-ab406e6f3738 tempest-AttachVolumeTestJSON-297536414 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.151s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:04:37.394847 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f492cc3c-a428-4920-a776-43159333a81c req-9536a96f-42b5-4f68-8198-ab406e6f3738 tempest-AttachVolumeTestJSON-297536414 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b5bc46c5-266e-44bc-843e-b5f8243721f5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'b5bc46c5-266e-44bc-843e-b5f8243721f5', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:04:37.454010 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f492cc3c-a428-4920-a776-43159333a81c req-9536a96f-42b5-4f68-8198-ab406e6f3738 tempest-AttachVolumeTestJSON-297536414 None] Connection info returned from driver {'name': 'volumes/volume-b5bc46c5-266e-44bc-843e-b5f8243721f5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b5bc46c5-266e-44bc-843e-b5f8243721f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f3e0c122-9f90-4b22-8ebe-7f9b939eb8f8'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:04:37.607892 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f492cc3c-a428-4920-a776-43159333a81c req-9536a96f-42b5-4f68-8198-ab406e6f3738 tempest-AttachVolumeTestJSON-297536414 None] attachment_update completed successfully. Mar 26 21:04:44.257900 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:44.295853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Flow 'volume_create_manager' (b88cca44-d67a-4322-8bb9-2e3d726bfa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:44.311201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7eb292-8e30-4b37-bdca-21d6a84c98b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.378641 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7eb292-8e30-4b37-bdca-21d6a84c98b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1498212177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=45bda0ad-ec70-4ddb-8738-e03f3cdb8087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb3a7ad720e4907adb342faacf61489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:44Z,use_quota=True,user_id='886e92bf0c794bbfaeddcd552df2a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.406455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294f4912-ef22-4044-9500-083f77dad499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.450252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294f4912-ef22-4044-9500-083f77dad499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.466116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f296a53-7af1-47bc-8f71-1f357e51930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.487125 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f296a53-7af1-47bc-8f71-1f357e51930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bda0ad-ec70-4ddb-8738-e03f3cdb8087', 'volume_name': 'volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.509605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b9d925-2811-4454-8962-f1c949e58946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.521399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b9d925-2811-4454-8962-f1c949e58946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.533368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c1182-9fe1-47b2-ab8b-3a7dc9714d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.543438 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Volume 45bda0ad-ec70-4ddb-8738-e03f3cdb8087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087', 'volume_size': 1} Mar 26 21:04:44.545723 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] creating volume 'volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:44.550923 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:44.767077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:44.768242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:44.773958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887c1182-9fe1-47b2-ab8b-3a7dc9714d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.787021 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4e9612-ddc7-4300-810c-c79c65b8994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:44.810883 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Volume volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087 (45bda0ad-ec70-4ddb-8738-e03f3cdb8087): created successfully Mar 26 21:04:44.820630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4e9612-ddc7-4300-810c-c79c65b8994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:44.828589 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Flow 'volume_create_manager' (b88cca44-d67a-4322-8bb9-2e3d726bfa3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:44.844872 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-39980b95-a21c-4807-bb89-c09a4d0ffebb tempest-SnapshotMetadataTestJSON-946469026 None] Created volume successfully. Mar 26 21:04:45.683905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6e29d38f-fcf9-4179-94e0-280642c3d069 tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:47.098041 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6e29d38f-fcf9-4179-94e0-280642c3d069 tempest-SnapshotMetadataTestJSON-946469026 None] Create snapshot completed successfully Mar 26 21:04:49.225425 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] Lock "b'cinder-fa04042f-97f8-46d6-b340-6ac53ecefd01-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.046s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:04:49.230212 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:50.076219 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:04:50.111693 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] Created reservations ['8892fa80-64eb-433f-9578-d4d491f2e783', 'c9b02daf-d871-4004-b857-5ca4794ea0e3', 'e70f4cac-174e-4662-9f67-1f9589d45851', '8398fe6b-382e-45c8-9632-c0c3d25eced3'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:50.205242 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] Delete snapshot completed successfully. Mar 26 21:04:50.216818 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-bcfe20d2-f205-47e1-8a79-b8bce4e8e74d tempest-SnapshotMetadataTestJSON-946469026 None] Lock "b'cinder-fa04042f-97f8-46d6-b340-6ac53ecefd01-delete_snapshot'" released by "delete_snapshot" :: held 0.993s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:04:50.456555 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Lock "b'cinder-45bda0ad-ec70-4ddb-8738-e03f3cdb8087-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:04:50.558033 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:50.704903 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:04:50.705640 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Volume volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:04:50.730422 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] deleting rbd volume volume-45bda0ad-ec70-4ddb-8738-e03f3cdb8087 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:04:51.370143 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Created reservations ['812172a8-b5fe-480d-89ee-3608b68eb4be', '44ee8510-508a-410d-9c4d-2567a5f0be8d', '32e6fc9f-0093-461b-9bbb-c943a101fcfd', '107df084-425c-4748-906f-c2b5d69935bd'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:04:51.473343 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:51.542270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:51.607033 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:51.623763 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Deleted volume successfully. Mar 26 21:04:51.647771 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-535eb4db-ece0-4748-9c1b-a35245879cc1 tempest-SnapshotMetadataTestJSON-946469026 None] Lock "b'cinder-45bda0ad-ec70-4ddb-8738-e03f3cdb8087-delete_volume'" released by "delete_volume" :: held 1.191s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:04:58.169950 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:04:58.171345 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:58.250077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:58.359147 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:04:59.246022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:04:59.278726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Flow 'volume_create_manager' (0a8f08ec-0fe5-4c12-bf67-eb81c92b0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:59.287622 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2565ff4-3461-4c72-a7a7-68263d088e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.322218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2565ff4-3461-4c72-a7a7-68263d088e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1112638238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac780a51-443e-4248-878a-2f1a66e180f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100b96fba71e4618bf68f23e69806e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:04:59Z,use_quota=True,user_id='dd80ca6705034995858dda31338a9112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.331985 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556fc24a-96f6-4f7a-ba9a-6ebeebb2afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.337290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556fc24a-96f6-4f7a-ba9a-6ebeebb2afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.345622 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2794df9c-5dbb-41b4-8856-326d3e4edee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.350892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2794df9c-5dbb-41b4-8856-326d3e4edee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac780a51-443e-4248-878a-2f1a66e180f3', 'volume_name': 'volume-ac780a51-443e-4248-878a-2f1a66e180f3', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.372896 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bd1246-621e-4f31-92fe-24bf8ee3e04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.385282 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bd1246-621e-4f31-92fe-24bf8ee3e04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.401440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f4ceb7-1d59-4db6-85d3-b57902f2066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.404295 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Volume ac780a51-443e-4248-878a-2f1a66e180f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac780a51-443e-4248-878a-2f1a66e180f3', 'volume_size': 1} Mar 26 21:04:59.404907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] creating volume 'volume-ac780a51-443e-4248-878a-2f1a66e180f3' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:04:59.407179 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:04:59.606108 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:04:59.606888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:04:59.620814 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f4ceb7-1d59-4db6-85d3-b57902f2066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac780a51-443e-4248-878a-2f1a66e180f3', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.645738 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ef01c4-dd96-446b-86f5-d4da7bd8da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:04:59.702564 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Volume volume-ac780a51-443e-4248-878a-2f1a66e180f3 (ac780a51-443e-4248-878a-2f1a66e180f3): created successfully Mar 26 21:04:59.721678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ef01c4-dd96-446b-86f5-d4da7bd8da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:04:59.738048 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Flow 'volume_create_manager' (0a8f08ec-0fe5-4c12-bf67-eb81c92b0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:04:59.759892 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ef8ed7e9-e306-4280-b5bb-c54e8dc68274 tempest-VolumesTransfersTest-1063695 None] Created volume successfully. Mar 26 21:05:01.272767 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-216edd1b-2305-43ff-8e71-ef2d5beaaab4 tempest-VolumesTransfersTest-1419488512 None] Transfer volume completed successfully. Mar 26 21:05:02.079654 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Lock "b'cinder-ac780a51-443e-4248-878a-2f1a66e180f3-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:02.121366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:02.253755 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:05:02.254437 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Volume volume-ac780a51-443e-4248-878a-2f1a66e180f3 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:05:02.278137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] deleting rbd volume volume-ac780a51-443e-4248-878a-2f1a66e180f3 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:05:02.984750 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Created reservations ['c296a0b8-1b5f-466e-8533-11ef86cab719', 'f8c3c767-9928-4ed3-90e2-a808403d4b66', 'e98aeff0-71a0-4194-ab33-5f46c449f52a', 'a8433518-31f6-4803-a936-c60184547b0d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:03.129326 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:03.213615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:03.321050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:05:03.336077 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Deleted volume successfully. Mar 26 21:05:03.372615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-bd5648ee-e308-4dd3-84a9-3eaea90b91d0 tempest-VolumesTransfersTest-2124032383 None] Lock "b'cinder-ac780a51-443e-4248-878a-2f1a66e180f3-delete_volume'" released by "delete_volume" :: held 1.293s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:03.827605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:03.859132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Flow 'volume_create_manager' (0a76ef12-1731-441d-bad8-6ae20a99842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:03.866588 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1421fb-f882-427c-ae8d-a84e7cf1e1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:03.884203 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1421fb-f882-427c-ae8d-a84e7cf1e1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1502718085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4124ae2-0d77-42b6-aee0-76548a2b741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100b96fba71e4618bf68f23e69806e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:04Z,use_quota=True,user_id='dd80ca6705034995858dda31338a9112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:03.891182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db8d816-f953-4ce7-bc84-3cbfff0b7863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:03.896560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db8d816-f953-4ce7-bc84-3cbfff0b7863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:03.902699 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e20df7-69c7-40b0-b0cf-c911ff52576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:03.908505 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e20df7-69c7-40b0-b0cf-c911ff52576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4124ae2-0d77-42b6-aee0-76548a2b741e', 'volume_name': 'volume-f4124ae2-0d77-42b6-aee0-76548a2b741e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:03.914948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb1e40-9a53-4f1c-9d19-155c0fdcc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:03.919252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ceb1e40-9a53-4f1c-9d19-155c0fdcc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:03.924566 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39186b05-ce4a-40a2-96b0-e2c7343f70f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:03.925972 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Volume f4124ae2-0d77-42b6-aee0-76548a2b741e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4124ae2-0d77-42b6-aee0-76548a2b741e', 'volume_size': 1} Mar 26 21:05:03.926596 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] creating volume 'volume-f4124ae2-0d77-42b6-aee0-76548a2b741e' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:03.927618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:04.077784 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:04.079090 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:04.084946 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39186b05-ce4a-40a2-96b0-e2c7343f70f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4124ae2-0d77-42b6-aee0-76548a2b741e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:04.095236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a75d78-0c65-4075-b959-ff2112f72041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:04.108026 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Volume volume-f4124ae2-0d77-42b6-aee0-76548a2b741e (f4124ae2-0d77-42b6-aee0-76548a2b741e): created successfully Mar 26 21:05:04.115805 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a75d78-0c65-4075-b959-ff2112f72041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:04.125090 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Flow 'volume_create_manager' (0a76ef12-1731-441d-bad8-6ae20a99842c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:04.180156 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-070bc756-3f14-480d-83f3-8cd447aefc2e tempest-VolumesTransfersTest-1063695 None] Created volume successfully. Mar 26 21:05:05.604667 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Lock "b'cinder-f4124ae2-0d77-42b6-aee0-76548a2b741e-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:05.683656 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:05.781606 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:05:05.782346 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Volume volume-f4124ae2-0d77-42b6-aee0-76548a2b741e is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:05:05.794021 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] deleting rbd volume volume-f4124ae2-0d77-42b6-aee0-76548a2b741e {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:05:06.259112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Created reservations ['dce7c078-31eb-4756-bbce-ddae836e471e', '716cc091-04c0-4f84-bce8-642d5ffd8f3f', '0795e64c-21de-4e59-a946-9881135ee2d8', '81885dbf-9328-4d49-927f-0b6eeb0ec8da'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:06.366626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:06.420895 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:06.464166 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:05:06.469180 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Deleted volume successfully. Mar 26 21:05:06.491692 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27bd41fc-bffd-409f-bb64-14e28868f144 tempest-VolumesTransfersTest-2124032383 None] Lock "b'cinder-f4124ae2-0d77-42b6-aee0-76548a2b741e-delete_volume'" released by "delete_volume" :: held 0.887s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:14.250347 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-d8588eaf-c201-4548-8b51-8660624ef318 req-1793f47f-8903-49c6-b91a-0b702a863bf0 tempest-AttachVolumeShelveTestJSON-1677154310 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:05:15.405997 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-d8588eaf-c201-4548-8b51-8660624ef318 req-1793f47f-8903-49c6-b91a-0b702a863bf0 tempest-AttachVolumeShelveTestJSON-1677154310 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.161s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:05:15.406784 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d8588eaf-c201-4548-8b51-8660624ef318 req-1793f47f-8903-49c6-b91a-0b702a863bf0 tempest-AttachVolumeShelveTestJSON-1677154310 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-575bb058-c5ae-4a01-831b-e61c0faaa551', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '575bb058-c5ae-4a01-831b-e61c0faaa551', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:05:15.453091 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-d8588eaf-c201-4548-8b51-8660624ef318 req-1793f47f-8903-49c6-b91a-0b702a863bf0 tempest-AttachVolumeShelveTestJSON-1677154310 None] Connection info returned from driver {'name': 'volumes/volume-575bb058-c5ae-4a01-831b-e61c0faaa551', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '575bb058-c5ae-4a01-831b-e61c0faaa551', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c6a040b-c95a-4c0a-9bcd-49158b5e53e4'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:05:15.639856 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d8588eaf-c201-4548-8b51-8660624ef318 req-1793f47f-8903-49c6-b91a-0b702a863bf0 tempest-AttachVolumeShelveTestJSON-1677154310 None] attachment_update completed successfully. Mar 26 21:05:17.729401 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:17.769202 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Flow 'volume_create_manager' (534bf10f-be99-4652-b262-1a2f35fc0697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:17.779905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d03163-d574-4d49-bbda-564704b69cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:17.817157 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d03163-d574-4d49-bbda-564704b69cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-565645049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d2f0857c-a8a8-443e-a1e7-967cfbf9c425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7fbf8ed36f46d5934e9967cb604a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:18Z,use_quota=True,user_id='2cb760e247964721bf5933dac15c7669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:17.830583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25daa7e9-b366-4a94-9fa4-df22a3fcbaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:17.837486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25daa7e9-b366-4a94-9fa4-df22a3fcbaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:17.866153 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e14a484-271d-467f-8694-34c0eb1c3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:17.872792 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e14a484-271d-467f-8694-34c0eb1c3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f0857c-a8a8-443e-a1e7-967cfbf9c425', 'volume_name': 'volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:17.880130 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c818b1f-4f8a-4937-8b69-4f2da1becd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:17.886983 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c818b1f-4f8a-4937-8b69-4f2da1becd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:17.894116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135e19f0-11ca-4990-82c9-737fd0cd6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:17.896271 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Volume d2f0857c-a8a8-443e-a1e7-967cfbf9c425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425', 'volume_size': 1} Mar 26 21:05:17.897105 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] creating volume 'volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:17.898343 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:18.055292 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:18.057624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:18.065652 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135e19f0-11ca-4990-82c9-737fd0cd6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:18.078321 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1b716b-d07c-4fec-badb-137fcb71f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:18.094390 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Volume volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425 (d2f0857c-a8a8-443e-a1e7-967cfbf9c425): created successfully Mar 26 21:05:18.100364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1b716b-d07c-4fec-badb-137fcb71f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:18.108245 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Flow 'volume_create_manager' (534bf10f-be99-4652-b262-1a2f35fc0697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:18.125972 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c133e614-ab49-4bcd-a8f7-c6cee5c42de1 tempest-VolumesTransfersV355Test-642880892 None] Created volume successfully. Mar 26 21:05:20.157275 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fe364bfd-95dd-4c11-b7c2-2aa0c78962d0 tempest-VolumesTransfersV355Test-946515817 None] Transfer volume completed successfully. Mar 26 21:05:21.396873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Lock "b'cinder-d2f0857c-a8a8-443e-a1e7-967cfbf9c425-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:21.455983 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:21.560588 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:05:21.561291 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Volume volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:05:21.575572 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] deleting rbd volume volume-d2f0857c-a8a8-443e-a1e7-967cfbf9c425 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:05:22.051372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Created reservations ['e007f313-b2fe-4aef-9415-b1ec6a7fe05b', 'f022ce20-c95c-42c3-856a-61c377e19ef7', '56db9ae9-6299-4949-9a50-081011e94782', '591cf0a0-8947-4159-bf58-71adac879f64'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:22.144631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:22.240327 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:22.344024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:05:22.349650 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Deleted volume successfully. Mar 26 21:05:22.372989 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3304cb14-9fea-4e3d-8bd4-5cd2036d4159 tempest-VolumesTransfersV355Test-1236256944 None] Lock "b'cinder-d2f0857c-a8a8-443e-a1e7-967cfbf9c425-delete_volume'" released by "delete_volume" :: held 0.976s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:23.503523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:23.573139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Flow 'volume_create_manager' (4735e388-25a3-43b0-89e0-aeec6e3327e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:23.582962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfd61e6-d11e-491e-9428-9b87fb4d34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.616464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfd61e6-d11e-491e-9428-9b87fb4d34c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-683470342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e864f421-9ff8-45b2-9528-31392b46083f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7fbf8ed36f46d5934e9967cb604a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:23Z,use_quota=True,user_id='2cb760e247964721bf5933dac15c7669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:23.634261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723ef2df-4fe8-40d4-8079-5cf58d7c05ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.639034 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723ef2df-4fe8-40d4-8079-5cf58d7c05ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:23.662730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aefc1a-bc0e-4164-9f41-b449893954e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.675518 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aefc1a-bc0e-4164-9f41-b449893954e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e864f421-9ff8-45b2-9528-31392b46083f', 'volume_name': 'volume-e864f421-9ff8-45b2-9528-31392b46083f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:23.692454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed153a2-adf7-4686-b103-4147bf448e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.698644 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed153a2-adf7-4686-b103-4147bf448e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:23.720080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36b6fc-0dfe-4786-8631-8c3dff659398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.725327 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Volume e864f421-9ff8-45b2-9528-31392b46083f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e864f421-9ff8-45b2-9528-31392b46083f', 'volume_size': 1} Mar 26 21:05:23.725746 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] creating volume 'volume-e864f421-9ff8-45b2-9528-31392b46083f' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:23.729015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:23.811247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:23.892234 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Flow 'volume_create_manager' (09b8bff8-19b3-4e07-b9b5-f0bc022956b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:23.908237 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5ad64b-45cc-41b1-a340-5a7d603fcff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:23.921676 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:23.922344 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:23.932477 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36b6fc-0dfe-4786-8631-8c3dff659398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e864f421-9ff8-45b2-9528-31392b46083f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:23.939662 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b48bba5-f150-4cbc-b8fa-f4d2a963952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.020141 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5ad64b-45cc-41b1-a340-5a7d603fcff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-441090145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2cfb8459-6389-48d4-97fc-57fedabc288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258cf569fc074fe6a826e67bf2a864ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:24Z,use_quota=True,user_id='e9e0fa13f5ac4f5bad836e6c61f4b890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.056032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c54224-97bd-4065-a4eb-d2ee9d6b2ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.068073 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c54224-97bd-4065-a4eb-d2ee9d6b2ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.090299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39555a1-4c85-4ea6-81ca-9d91dfd37a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.117780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39555a1-4c85-4ea6-81ca-9d91dfd37a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfb8459-6389-48d4-97fc-57fedabc288a', 'volume_name': 'volume-2cfb8459-6389-48d4-97fc-57fedabc288a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.131258 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f94daa8-551a-49fa-a1cb-385c5f8ebf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.144958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f94daa8-551a-49fa-a1cb-385c5f8ebf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.150859 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902fc6e2-ff38-4503-8214-e874204b0222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.157862 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Volume 2cfb8459-6389-48d4-97fc-57fedabc288a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfb8459-6389-48d4-97fc-57fedabc288a', 'volume_size': 1} Mar 26 21:05:24.162096 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] creating volume 'volume-2cfb8459-6389-48d4-97fc-57fedabc288a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:24.163882 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:24.203487 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Volume volume-e864f421-9ff8-45b2-9528-31392b46083f (e864f421-9ff8-45b2-9528-31392b46083f): created successfully Mar 26 21:05:24.207802 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b48bba5-f150-4cbc-b8fa-f4d2a963952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.234562 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Flow 'volume_create_manager' (4735e388-25a3-43b0-89e0-aeec6e3327e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:24.262771 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-12df3466-1930-4fdc-9c76-a9d6dd546008 tempest-VolumesTransfersV355Test-642880892 None] Created volume successfully. Mar 26 21:05:24.290183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:24.291546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:24.305189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902fc6e2-ff38-4503-8214-e874204b0222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfb8459-6389-48d4-97fc-57fedabc288a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.350367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28725611-561a-40c1-a8d5-934f7e7dab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:24.369971 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Volume volume-2cfb8459-6389-48d4-97fc-57fedabc288a (2cfb8459-6389-48d4-97fc-57fedabc288a): created successfully Mar 26 21:05:24.378201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28725611-561a-40c1-a8d5-934f7e7dab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:24.394783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Flow 'volume_create_manager' (09b8bff8-19b3-4e07-b9b5-f0bc022956b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:24.416822 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d req-5691a4f1-fd9f-4a1f-81ee-fdd5cdff5d84 tempest-VolumesSnapshotsTestJSON-1134480779 None] Created volume successfully. Mar 26 21:05:25.128942 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Lock "b'cinder-e864f421-9ff8-45b2-9528-31392b46083f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:25.255045 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:25.397907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:05:25.398713 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Volume volume-e864f421-9ff8-45b2-9528-31392b46083f is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:05:25.409534 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] deleting rbd volume volume-e864f421-9ff8-45b2-9528-31392b46083f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:05:25.498868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6712a9f1-66d1-49db-90ef-a43034eff727 req-cabb4538-e4c5-4df4-bdeb-e2d3501a103e tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:25.872364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Created reservations ['7a57554e-35fc-4dc2-a491-9e772ef925bc', '270e0ee0-f476-4a4b-919e-703b162c1d64', 'de1d0e4b-d6f6-4056-86d4-5bd2384950b5', 'd199f529-a73a-41bf-8a8e-574fd42cdf6e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:26.065277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:26.173192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:26.286309 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:05:26.302355 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6712a9f1-66d1-49db-90ef-a43034eff727 req-cabb4538-e4c5-4df4-bdeb-e2d3501a103e tempest-VolumesSnapshotsTestJSON-1134480779 None] Create snapshot completed successfully Mar 26 21:05:26.336547 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Deleted volume successfully. Mar 26 21:05:26.370635 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5ddb11d5-78aa-4fa8-98fb-d319e44377a9 tempest-VolumesTransfersV355Test-1236256944 None] Lock "b'cinder-e864f421-9ff8-45b2-9528-31392b46083f-delete_volume'" released by "delete_volume" :: held 1.242s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:26.979501 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-2282b651-161f-412b-8ba7-71f9d3e56a68 req-25d22a06-9a48-4e8b-9a06-9e84f72bf67e tempest-VolumesSnapshotsTestJSON-1134480779 None] Lock "b'cinder-0bff87eb-fa86-47c7-bae2-4a0593059e37-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:26.982520 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-2282b651-161f-412b-8ba7-71f9d3e56a68 req-25d22a06-9a48-4e8b-9a06-9e84f72bf67e tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:28.128951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-2282b651-161f-412b-8ba7-71f9d3e56a68 req-25d22a06-9a48-4e8b-9a06-9e84f72bf67e tempest-VolumesSnapshotsTestJSON-1134480779 None] Created reservations ['81860155-111d-458b-a815-253ba502fc6e', '05a52bb0-e95a-434d-a5a3-45d53dd14c99', 'c403d692-fd6e-45b1-8820-cb8dba608404', 'e5eb675e-cc0d-4b7d-a7eb-13119ec047ea'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:28.217084 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-2282b651-161f-412b-8ba7-71f9d3e56a68 req-25d22a06-9a48-4e8b-9a06-9e84f72bf67e tempest-VolumesSnapshotsTestJSON-1134480779 None] Delete snapshot completed successfully. Mar 26 21:05:28.226716 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-2282b651-161f-412b-8ba7-71f9d3e56a68 req-25d22a06-9a48-4e8b-9a06-9e84f72bf67e tempest-VolumesSnapshotsTestJSON-1134480779 None] Lock "b'cinder-0bff87eb-fa86-47c7-bae2-4a0593059e37-delete_snapshot'" released by "delete_snapshot" :: held 1.254s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:28.377665 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Lock "b'cinder-2cfb8459-6389-48d4-97fc-57fedabc288a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:05:28.504384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:28.614289 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:05:28.615884 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Volume volume-2cfb8459-6389-48d4-97fc-57fedabc288a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:05:28.630613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] deleting rbd volume volume-2cfb8459-6389-48d4-97fc-57fedabc288a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:05:29.023741 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Created reservations ['ab978840-6f71-454e-8290-cacb738887c9', 'a03b83fd-ea89-48db-ac55-f1765156c62d', '85378d95-85d6-4cfb-9169-66527324efb5', '52496a97-9e8b-46b1-a409-96cbfb2807ac'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:05:29.091688 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:29.174077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:29.254945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:05:29.259824 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Deleted volume successfully. Mar 26 21:05:29.276310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-91b3d960-37b8-45b2-acf3-e8220913aba8 req-dc7a11f9-d890-4f51-86d3-bfa4eb441bb2 tempest-VolumesSnapshotsTestJSON-1134480779 None] Lock "b'cinder-2cfb8459-6389-48d4-97fc-57fedabc288a-delete_volume'" released by "delete_volume" :: held 0.899s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:05:34.782270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:34.826465 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Flow 'volume_create_manager' (9d31f71c-ee4f-4dbc-b8b7-9decd38196ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:34.847820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01679f7-9d3a-49e8-914d-3114fbb6c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:34.874901 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01679f7-9d3a-49e8-914d-3114fbb6c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-319441218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=204cc716-9e67-4893-bf93-9d9aa8775463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffeef0caf635437194fed3721a8d1d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:35Z,use_quota=True,user_id='bfac7b943d654fc88c08d106d57201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:34.891808 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd12e04-cd88-4836-8bae-0e6d0a8d16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:34.903264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd12e04-cd88-4836-8bae-0e6d0a8d16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:34.916032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496115f-8755-4c39-8d15-1bb3fb986c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:34.923019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c496115f-8755-4c39-8d15-1bb3fb986c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204cc716-9e67-4893-bf93-9d9aa8775463', 'volume_name': 'volume-204cc716-9e67-4893-bf93-9d9aa8775463', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:34.931868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e63e42f-bd96-46b7-86b9-0a78dcd3dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:34.940338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e63e42f-bd96-46b7-86b9-0a78dcd3dd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:34.949404 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaf20fe-ca2b-4837-b038-3717518aba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:34.950852 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Volume 204cc716-9e67-4893-bf93-9d9aa8775463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204cc716-9e67-4893-bf93-9d9aa8775463', 'volume_size': 1} Mar 26 21:05:34.951359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] creating volume 'volume-204cc716-9e67-4893-bf93-9d9aa8775463' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:34.952334 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:35.063044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:35.063461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:35.070009 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaf20fe-ca2b-4837-b038-3717518aba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204cc716-9e67-4893-bf93-9d9aa8775463', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:35.077623 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c166e09-8ac1-47d7-a612-94c5b42c3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:35.092129 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Volume volume-204cc716-9e67-4893-bf93-9d9aa8775463 (204cc716-9e67-4893-bf93-9d9aa8775463): created successfully Mar 26 21:05:35.100324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c166e09-8ac1-47d7-a612-94c5b42c3385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:35.105992 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Flow 'volume_create_manager' (9d31f71c-ee4f-4dbc-b8b7-9decd38196ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:35.116902 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d684ed58-f8fd-43ee-a9cf-fa37364a6975 tempest-VolumesNegativeTest-1084825935 None] Created volume successfully. Mar 26 21:05:37.258473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:05:37.311232 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Flow 'volume_create_manager' (31aafeaf-9ae9-42cb-a2fb-beeb2285cdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:37.334271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e15df16-ee9c-41b2-bc7a-5b486c8cd1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.366707 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e15df16-ee9c-41b2-bc7a-5b486c8cd1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1488835075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af628bd3-b055-4def-b114-c56cacb63061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614df0ac05da469a932c527c1d5c0a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:05:37Z,use_quota=True,user_id='f265820a8b974837949e9e3f36b58858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.380190 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538784ad-5de8-4951-9edb-e59ade7c4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.386308 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538784ad-5de8-4951-9edb-e59ade7c4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.392418 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bedbfb5-b30f-4154-90ee-04dcae211d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.409508 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bedbfb5-b30f-4154-90ee-04dcae211d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af628bd3-b055-4def-b114-c56cacb63061', 'volume_name': 'volume-af628bd3-b055-4def-b114-c56cacb63061', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.420979 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0822135-30e6-4e9c-8243-cdcfddfe4ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.426026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0822135-30e6-4e9c-8243-cdcfddfe4ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.446728 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d9a728-e3ad-49ee-8500-58dbbe24bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.448623 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Volume af628bd3-b055-4def-b114-c56cacb63061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af628bd3-b055-4def-b114-c56cacb63061', 'volume_size': 1} Mar 26 21:05:37.449095 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] creating volume 'volume-af628bd3-b055-4def-b114-c56cacb63061' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:05:37.450005 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:37.561063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:05:37.561456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:05:37.566041 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d9a728-e3ad-49ee-8500-58dbbe24bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af628bd3-b055-4def-b114-c56cacb63061', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.572310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343ab39-59fc-4350-bf51-06c30ec9bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:05:37.581940 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Volume volume-af628bd3-b055-4def-b114-c56cacb63061 (af628bd3-b055-4def-b114-c56cacb63061): created successfully Mar 26 21:05:37.585915 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343ab39-59fc-4350-bf51-06c30ec9bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:05:37.593885 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Flow 'volume_create_manager' (31aafeaf-9ae9-42cb-a2fb-beeb2285cdbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:05:37.604329 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ae753e20-f6d0-43c6-b116-9919af9135eb tempest-DeleteServersTestJSON-1584739936 None] Created volume successfully. Mar 26 21:05:39.032990 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a req-42274458-7689-4df1-a0eb-28e91fbc0d35 tempest-AttachVolumeTestJSON-297536414 None] Terminate volume connection completed successfully. Mar 26 21:05:39.034896 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a req-42274458-7689-4df1-a0eb-28e91fbc0d35 tempest-AttachVolumeTestJSON-297536414 None] Deleting attachment f3e0c122-9f90-4b22-8ebe-7f9b939eb8f8. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:05:39.155643 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-833b6ca7-9058-4224-af24-bca27e5754cc req-f7756076-eb80-4b43-8f3a-f145019b24bd tempest-DeleteServersTestJSON-1584739936 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:05:40.554190 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-833b6ca7-9058-4224-af24-bca27e5754cc req-f7756076-eb80-4b43-8f3a-f145019b24bd tempest-DeleteServersTestJSON-1584739936 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.398s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:05:40.555521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-833b6ca7-9058-4224-af24-bca27e5754cc req-f7756076-eb80-4b43-8f3a-f145019b24bd tempest-DeleteServersTestJSON-1584739936 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-af628bd3-b055-4def-b114-c56cacb63061', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'af628bd3-b055-4def-b114-c56cacb63061', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:05:40.616503 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-833b6ca7-9058-4224-af24-bca27e5754cc req-f7756076-eb80-4b43-8f3a-f145019b24bd tempest-DeleteServersTestJSON-1584739936 None] Connection info returned from driver {'name': 'volumes/volume-af628bd3-b055-4def-b114-c56cacb63061', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'af628bd3-b055-4def-b114-c56cacb63061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f56c21ee-ce72-480b-b182-e87ca5723475'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:05:40.776744 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-833b6ca7-9058-4224-af24-bca27e5754cc req-f7756076-eb80-4b43-8f3a-f145019b24bd tempest-DeleteServersTestJSON-1584739936 None] attachment_update completed successfully. Mar 26 21:05:48.198476 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-175c486f-3dd2-446e-b463-dbe3639f11f7 req-3ef25ef8-f416-4648-84f2-9be37e1da96e tempest-DeleteServersTestJSON-1584739936 None] Terminate volume connection completed successfully. Mar 26 21:05:48.199162 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-175c486f-3dd2-446e-b463-dbe3639f11f7 req-3ef25ef8-f416-4648-84f2-9be37e1da96e tempest-DeleteServersTestJSON-1584739936 None] Deleting attachment f56c21ee-ce72-480b-b182-e87ca5723475. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:05:58.175647 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:05:58.177673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:58.232122 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:05:58.296704 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:06:01.940517 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Lock "b'cinder-204cc716-9e67-4893-bf93-9d9aa8775463-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:06:02.004285 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:06:02.090079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:06:02.090601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Volume volume-204cc716-9e67-4893-bf93-9d9aa8775463 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:06:02.104925 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] deleting rbd volume volume-204cc716-9e67-4893-bf93-9d9aa8775463 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:06:02.593137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Created reservations ['4b3f6c07-17fd-4be9-a853-a45047bf5b8c', 'cd4799ee-62e6-4e6e-bdbb-fd1907347e7b', '0e456973-0988-4070-aab9-a594b3ed0a2c', '53a1ac15-a5ee-4bdc-b1c8-6fce8c9ddb88'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:06:02.640462 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:06:02.678182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:06:02.738976 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:06:02.744560 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Deleted volume successfully. Mar 26 21:06:02.761551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-ee5532d1-fe43-4591-8e1e-e26a06383390 tempest-VolumesNegativeTest-1084825935 None] Lock "b'cinder-204cc716-9e67-4893-bf93-9d9aa8775463-delete_volume'" released by "delete_volume" :: held 0.820s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:06:19.439014 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-8524f3d1-b5f2-4483-b3f8-16c05765942b req-9ea5b966-0302-4d36-8822-616d56b1751f tempest-AttachVolumeShelveTestJSON-1677154310 None] Terminate volume connection completed successfully. Mar 26 21:06:19.442359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-8524f3d1-b5f2-4483-b3f8-16c05765942b req-9ea5b966-0302-4d36-8822-616d56b1751f tempest-AttachVolumeShelveTestJSON-1677154310 None] Deleting attachment 3c6a040b-c95a-4c0a-9bcd-49158b5e53e4. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:06:58.172921 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:06:58.175460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:06:58.284156 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:06:58.399733 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:34.580440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:07:34.608420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Flow 'volume_create_manager' (f9cc5c61-e068-4942-b7dd-edd1fa0c5b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:34.618178 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107e278-2d68-4a37-915c-907f12b0c8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.645244 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107e278-2d68-4a37-915c-907f12b0c8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-72016602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50c9d877-37d7-4744-84b6-2d9f0034a94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a748aa42d5c4f55bd7d2d86838ff112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:07:34Z,use_quota=True,user_id='321431f1b82447d28c58e7d03fd20515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.653385 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d6308c-49fc-4ae9-bb13-d1c2931dd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.659552 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d6308c-49fc-4ae9-bb13-d1c2931dd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.678944 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32921105-bc23-4a3d-adb3-64809dd0352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.683943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32921105-bc23-4a3d-adb3-64809dd0352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c9d877-37d7-4744-84b6-2d9f0034a94d', 'volume_name': 'volume-50c9d877-37d7-4744-84b6-2d9f0034a94d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.695605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ed3de-c068-4dca-a321-f1995244b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.700836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4ed3de-c068-4dca-a321-f1995244b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.707749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707fb957-c62e-4af7-a512-96fc314e37ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.709766 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume 50c9d877-37d7-4744-84b6-2d9f0034a94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c9d877-37d7-4744-84b6-2d9f0034a94d', 'volume_size': 1} Mar 26 21:07:34.710264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] creating volume 'volume-50c9d877-37d7-4744-84b6-2d9f0034a94d' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:07:34.711899 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:34.779581 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-5f3d6a16-233f-4ee0-bb69-4ceece26e50b tempest-TaggedBootDevicesTest-1972550485 None] Terminate volume connection completed successfully. Mar 26 21:07:34.780780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-5f3d6a16-233f-4ee0-bb69-4ceece26e50b tempest-TaggedBootDevicesTest-1972550485 None] Deleting attachment 9df89e20-ad7d-45e0-8f0f-1c9a0ab797b0. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:07:34.851247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:07:34.852341 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:07:34.865975 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707fb957-c62e-4af7-a512-96fc314e37ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c9d877-37d7-4744-84b6-2d9f0034a94d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.906035 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd016e8-7740-473a-8e23-8032aab14869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:34.925657 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume volume-50c9d877-37d7-4744-84b6-2d9f0034a94d (50c9d877-37d7-4744-84b6-2d9f0034a94d): created successfully Mar 26 21:07:34.930286 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd016e8-7740-473a-8e23-8032aab14869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:34.959061 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Flow 'volume_create_manager' (f9cc5c61-e068-4942-b7dd-edd1fa0c5b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:35.023323 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4e27ca7a-7a60-4007-9f2c-03b49088e90f tempest-AttachVolumeShelveTestJSON-1677154310 None] Created volume successfully. Mar 26 21:07:35.059622 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-6f494b65-636c-411c-a5d8-46dda5d8ce4a tempest-TaggedBootDevicesTest-1972550485 None] Terminate volume connection completed successfully. Mar 26 21:07:35.060086 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-6f494b65-636c-411c-a5d8-46dda5d8ce4a tempest-TaggedBootDevicesTest-1972550485 None] Deleting attachment c1708993-fe7c-49b8-84e2-2e3cff4fd54a. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:07:35.289589 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-2f0e4d6d-bc30-42df-8f46-6dade80b11bf tempest-TaggedBootDevicesTest-1972550485 None] Terminate volume connection completed successfully. Mar 26 21:07:35.290006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-712568e9-5fe0-4310-802c-3ee1e3d5aacc req-2f0e4d6d-bc30-42df-8f46-6dade80b11bf tempest-TaggedBootDevicesTest-1972550485 None] Deleting attachment cea42939-d6c0-48c8-9e59-80d5244450dd. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:07:45.621790 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-65bed174-5bd9-4361-8a87-20e4a95b8976-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:07:45.671464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:45.788272 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:07:45.788865 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-65bed174-5bd9-4361-8a87-20e4a95b8976 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:07:45.799411 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] deleting rbd volume volume-65bed174-5bd9-4361-8a87-20e4a95b8976 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:07:46.216176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Created reservations ['922c3ec5-de9e-4caf-aa55-0d1841708fe6', '9bf7e514-ff55-48f7-a241-6e5eda474750', 'da1c6d83-3da4-4f26-8643-106a78af0e69', '1b955fba-734c-4146-8a3c-4de68fb6158e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:46.290222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:46.392029 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:46.483813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:46.504465 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Deleted volume successfully. Mar 26 21:07:46.542987 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-45185423-b523-4192-8bc7-49f9ef6f287a tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-65bed174-5bd9-4361-8a87-20e4a95b8976-delete_volume'" released by "delete_volume" :: held 0.919s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:07:46.799540 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2ea045fa-46ea-4e61-ab0e-2d1f8fce36cc tempest-GroupsV314Test-740075591 None] Group tempest-GroupsV314Test-Group-429344629: creating Mar 26 21:07:46.835161 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2ea045fa-46ea-4e61-ab0e-2d1f8fce36cc tempest-GroupsV314Test-740075591 None] Group tempest-GroupsV314Test-Group-429344629: created successfully Mar 26 21:07:46.846206 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2ea045fa-46ea-4e61-ab0e-2d1f8fce36cc tempest-GroupsV314Test-740075591 None] Create group completed successfully. Mar 26 21:07:46.891419 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:07:46.934588 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:46.986223 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:07:46.987858 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Volume volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:07:46.997429 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] deleting rbd volume volume-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:07:47.297505 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Created reservations ['2c61ceb9-8b83-4b61-afdf-6498870eadd1', '5ee7c4a6-7bde-4e84-9bb4-3aba1587bd7e', 'a42a7c77-833a-4365-b9e5-c112bb9bc002', 'd0abca6c-8540-43ba-939e-b91d2360a72a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:47.345191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:47.383447 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:47.415664 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:47.419974 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Deleted volume successfully. Mar 26 21:07:47.433909 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-16909209-833e-48ac-883b-cb2801b0acbf tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6-delete_volume'" released by "delete_volume" :: held 0.543s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:07:48.139465 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-d40ca192-1678-4361-83fa-186b54864c59-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:07:48.228464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:48.335764 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:07:48.350153 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] deleting rbd volume volume-d40ca192-1678-4361-83fa-186b54864c59 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:07:48.575780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:07:48.597243 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Flow 'volume_create_manager' (c50b482d-974d-48d7-8608-2cd7f857c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:48.625103 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e68a73-c82a-4cee-b9e1-db62412a439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:48.643868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e68a73-c82a-4cee-b9e1-db62412a439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1252484784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7289ea06-8d43-478a-b0ba-5c6e615cb19d,host='ncdv-master-1@ceph#ceph',id=05a04d07-bf7e-4460-b819-06e2344eff90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0ac400cb14a409d8b96581772ca43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:07:49Z,use_quota=True,user_id='65fba680497542c7b71781a3edc7d5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fe87ba4-8939-424c-9e1a-c4b76f3600d6),volume_type_id=1fe87ba4-8939-424c-9e1a-c4b76f3600d6)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:48.650076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4872631-a1d8-4da0-9583-5b6f72df69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:48.654620 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4872631-a1d8-4da0-9583-5b6f72df69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:48.660527 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55323db8-99e4-499e-a742-b693221e7a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:48.665324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55323db8-99e4-499e-a742-b693221e7a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a04d07-bf7e-4460-b819-06e2344eff90', 'volume_name': 'volume-05a04d07-bf7e-4460-b819-06e2344eff90', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:48.670913 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7356f6-41e9-484f-b9de-33c4880953c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:48.675153 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7356f6-41e9-484f-b9de-33c4880953c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:48.681295 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333acc19-4d56-4742-a7a3-f76c47dfbb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:48.682690 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Volume 05a04d07-bf7e-4460-b819-06e2344eff90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a04d07-bf7e-4460-b819-06e2344eff90', 'volume_size': 1} Mar 26 21:07:48.683204 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] creating volume 'volume-05a04d07-bf7e-4460-b819-06e2344eff90' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:07:48.684130 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:48.756095 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:07:48.786682 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] deleting parent snapshot volume-d40ca192-1678-4361-83fa-186b54864c59.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:07:49.136992 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:07:49.137530 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:07:49.141791 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333acc19-4d56-4742-a7a3-f76c47dfbb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a04d07-bf7e-4460-b819-06e2344eff90', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:49.147542 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6bed2f-0739-47aa-a55b-50e075903624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:49.162021 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Volume volume-05a04d07-bf7e-4460-b819-06e2344eff90 (05a04d07-bf7e-4460-b819-06e2344eff90): created successfully Mar 26 21:07:49.165909 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6bed2f-0739-47aa-a55b-50e075903624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:49.173058 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Flow 'volume_create_manager' (c50b482d-974d-48d7-8608-2cd7f857c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:49.185962 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e96b94bc-14ec-4911-8c20-bec50702d03a tempest-GroupsV314Test-740075591 None] Created volume successfully. Mar 26 21:07:49.209981 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] Created reservations ['a157ff27-480a-4e50-8eb1-de2c5dc45815', 'c74bf4bd-6269-4105-bcfe-3d9d345a144c', 'bcab804c-3c9d-4e8c-a54f-3d776adaabf5', '40009f74-8e93-420e-9cc2-40dae5c5e1c4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:49.265469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:49.320100 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:49.384763 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:49.402025 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] Deleted volume successfully. Mar 26 21:07:49.420781 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2ed12fb6-bff4-4947-8296-f37b659980df tempest-TaggedBootDevicesTest-1972550485 None] Lock "b'cinder-d40ca192-1678-4361-83fa-186b54864c59-delete_volume'" released by "delete_volume" :: held 1.277s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:07:50.225949 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:50.292270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] creating snapshot='volume-4b0528f8-7c63-44b3-ba79-26fcaa177198.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:07:51.185117 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] cloning 'volume-05a04d07-bf7e-4460-b819-06e2344eff90@volume-4b0528f8-7c63-44b3-ba79-26fcaa177198.clone_snap' to 'volume-4b0528f8-7c63-44b3-ba79-26fcaa177198' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:07:51.377155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] Volume volume-05a04d07-bf7e-4460-b819-06e2344eff90 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:07:51.393342 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:07:51.394083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:07:51.429042 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:07:51.530921 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e8db7d3d-ad46-4d92-84f2-76f0faf228d1 tempest-GroupsV314Test-740075591 None] Create group from source-group-7289ea06-8d43-478a-b0ba-5c6e615cb19d completed successfully. Mar 26 21:07:51.791184 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:07:51.818004 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (2bdf263f-6421-4e31-a05e-7023237642a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:51.826143 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18525da-83e0-4984-96b0-d788b1826c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:51.873975 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18525da-83e0-4984-96b0-d788b1826c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1198357891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f610a18f-caa9-441d-a864-6de8abe1f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32df8b04107445c89edb0d809d87d6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:07:52Z,use_quota=True,user_id='8cab4cf432764bb487de9abc0f283898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:51.881571 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf893df3-4e56-48ae-b853-58d5cd13ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:51.886744 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf893df3-4e56-48ae-b853-58d5cd13ad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:51.894830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d434aa-e21e-4fcb-a843-e919dfceed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:51.902578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d434aa-e21e-4fcb-a843-e919dfceed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f610a18f-caa9-441d-a864-6de8abe1f502', 'volume_name': 'volume-f610a18f-caa9-441d-a864-6de8abe1f502', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:51.910370 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeeef566-c94e-4307-9570-ad7621c38c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:51.915455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeeef566-c94e-4307-9570-ad7621c38c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:51.921356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb14a48-954e-4bba-8262-6334fce4a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:51.923461 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Volume f610a18f-caa9-441d-a864-6de8abe1f502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f610a18f-caa9-441d-a864-6de8abe1f502', 'volume_size': 1} Mar 26 21:07:51.924041 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] creating volume 'volume-f610a18f-caa9-441d-a864-6de8abe1f502' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:07:51.925024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:52.072618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:07:52.073191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:07:52.080655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb14a48-954e-4bba-8262-6334fce4a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f610a18f-caa9-441d-a864-6de8abe1f502', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:52.091709 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c98925-65f5-4148-a6db-216789624ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:52.144124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:52.228315 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:07:52.240536 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] deleting rbd volume volume-4b0528f8-7c63-44b3-ba79-26fcaa177198 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:07:52.244660 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-f610a18f-caa9-441d-a864-6de8abe1f502 (f610a18f-caa9-441d-a864-6de8abe1f502): created successfully Mar 26 21:07:52.248964 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c98925-65f5-4148-a6db-216789624ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:52.258136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (2bdf263f-6421-4e31-a05e-7023237642a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:52.276328 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d3cd4b9a-1b6f-413c-8299-7ef748624558 tempest-AttachVolumeTestJSON-297536414 None] Created volume successfully. Mar 26 21:07:52.589566 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:07:52.619253 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Volume volume-05a04d07-bf7e-4460-b819-06e2344eff90 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:07:52.620655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] deleting parent snapshot volume-4b0528f8-7c63-44b3-ba79-26fcaa177198.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:07:53.307350 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Created reservations ['524eea32-9f69-4150-8bb7-a1c2bb7e1c46'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:53.375975 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-916824025 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-916824025, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:07:53.376800 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-916824025 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-916824025, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:07:53.404160 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Created reservations ['1da9411b-f5a1-4244-add5-e40dee5f9656', '2b6f5b13-9177-4db7-83ff-ea99154bd4f9', 'b8b845ce-5654-461e-836a-a19bb78e95b1', '79e581e2-c7c8-439b-894b-f4e88c9e7df3'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:53.606316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:53.668140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:53.740036 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:53.757168 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4c8d3ea6-e7e5-4039-87fc-1a3370bee6e4 tempest-GroupsV314Test-740075591 None] Delete group completed successfully. Mar 26 21:07:53.777676 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-3e922b8c-065d-4028-ac43-fb93c8e7252d req-15cefe23-68de-4bc3-81c9-a3314af5fdae tempest-AttachVolumeTestJSON-297536414 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:07:54.654424 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-3e922b8c-065d-4028-ac43-fb93c8e7252d req-15cefe23-68de-4bc3-81c9-a3314af5fdae tempest-AttachVolumeTestJSON-297536414 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.876s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:07:54.656744 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-3e922b8c-065d-4028-ac43-fb93c8e7252d req-15cefe23-68de-4bc3-81c9-a3314af5fdae tempest-AttachVolumeTestJSON-297536414 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f610a18f-caa9-441d-a864-6de8abe1f502', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'f610a18f-caa9-441d-a864-6de8abe1f502', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:07:54.720696 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-3e922b8c-065d-4028-ac43-fb93c8e7252d req-15cefe23-68de-4bc3-81c9-a3314af5fdae tempest-AttachVolumeTestJSON-297536414 None] Connection info returned from driver {'name': 'volumes/volume-f610a18f-caa9-441d-a864-6de8abe1f502', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f610a18f-caa9-441d-a864-6de8abe1f502', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '54bfddea-c3a9-4d33-b489-39d7fe6d4e0c'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:07:54.825915 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-3e922b8c-065d-4028-ac43-fb93c8e7252d req-15cefe23-68de-4bc3-81c9-a3314af5fdae tempest-AttachVolumeTestJSON-297536414 None] attachment_update completed successfully. Mar 26 21:07:55.083031 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:55.208910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:07:55.209758 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] Volume volume-05a04d07-bf7e-4460-b819-06e2344eff90 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:07:55.224811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] deleting rbd volume volume-05a04d07-bf7e-4460-b819-06e2344eff90 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:07:55.757534 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] Created reservations ['2e094aee-9e29-45db-a643-3709a7d43142'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:55.830561 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] Created reservations ['23b9b36e-7578-4eba-9f3d-c2758f801115', '522a5d0a-8e26-43f9-9871-ec52bb327f89', 'a501dabf-e837-48f0-ac03-69ff1d29d282', '9f29f4fc-a79f-4db9-b109-f8490d64bb39'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:07:55.979249 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:56.065459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:56.134280 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:56.141546 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e0d0214d-9405-4f29-8ed4-02e23d70a83b tempest-GroupsV314Test-740075591 None] Delete group completed successfully. Mar 26 21:07:58.171467 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:07:58.172175 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:58.240574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:58.318312 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:07:58.520835 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:07:58.550147 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (62590848-dc44-4512-97c4-e91651aa32a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:58.564092 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ae11b4-32a5-4dd3-940f-25975f23dc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.596188 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ae11b4-32a5-4dd3-940f-25975f23dc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97781775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ae8f0ee-e556-44ed-afeb-a79fcba7ce64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32df8b04107445c89edb0d809d87d6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:07:58Z,use_quota=True,user_id='8cab4cf432764bb487de9abc0f283898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.603564 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff4ca8f-e5ed-478e-aea7-5d038365a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.609825 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff4ca8f-e5ed-478e-aea7-5d038365a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.616473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391fc202-5d38-4882-acb5-6a0295fd8cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.649249 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391fc202-5d38-4882-acb5-6a0295fd8cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'volume_name': 'volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.676031 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dca5390-46a0-4b83-a5c8-5d5a7db4e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.685605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dca5390-46a0-4b83-a5c8-5d5a7db4e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.694520 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8348aa36-5a2c-4f00-aef8-c7b509105c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.696615 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Volume 0ae8f0ee-e556-44ed-afeb-a79fcba7ce64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'volume_size': 1} Mar 26 21:07:58.697424 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] creating volume 'volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:07:58.698871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:07:58.866341 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:07:58.866984 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:07:58.872676 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8348aa36-5a2c-4f00-aef8-c7b509105c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.887837 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c7118b-d39c-430a-aff6-03c639d38e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:07:58.915712 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64 (0ae8f0ee-e556-44ed-afeb-a79fcba7ce64): created successfully Mar 26 21:07:58.920278 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c7118b-d39c-430a-aff6-03c639d38e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:07:58.928132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Flow 'volume_create_manager' (62590848-dc44-4512-97c4-e91651aa32a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:07:58.943556 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0ea21ed5-0165-45db-8a1e-17fd28c65ba6 tempest-AttachVolumeTestJSON-297536414 None] Created volume successfully. Mar 26 21:08:00.262547 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f20d7f4b-b014-4b8d-8de3-60621df302c0 req-e1c43c87-e775-4715-85c4-6f0e9a21080a tempest-AttachVolumeTestJSON-297536414 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:08:01.606892 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f20d7f4b-b014-4b8d-8de3-60621df302c0 req-e1c43c87-e775-4715-85c4-6f0e9a21080a tempest-AttachVolumeTestJSON-297536414 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.344s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:08:01.608853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f20d7f4b-b014-4b8d-8de3-60621df302c0 req-e1c43c87-e775-4715-85c4-6f0e9a21080a tempest-AttachVolumeTestJSON-297536414 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:08:01.652084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f20d7f4b-b014-4b8d-8de3-60621df302c0 req-e1c43c87-e775-4715-85c4-6f0e9a21080a tempest-AttachVolumeTestJSON-297536414 None] Connection info returned from driver {'name': 'volumes/volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0ae8f0ee-e556-44ed-afeb-a79fcba7ce64', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6489bde2-3cda-45d3-84f4-8164b2bc6724'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:08:01.796510 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f20d7f4b-b014-4b8d-8de3-60621df302c0 req-e1c43c87-e775-4715-85c4-6f0e9a21080a tempest-AttachVolumeTestJSON-297536414 None] attachment_update completed successfully. Mar 26 21:08:05.355115 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-082b6e82-6352-4448-b065-0b06995d7a24 req-408831eb-061d-4cc0-925b-943eb85ef08f tempest-AttachVolumeTestJSON-297536414 None] Terminate volume connection completed successfully. Mar 26 21:08:05.355796 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-082b6e82-6352-4448-b065-0b06995d7a24 req-408831eb-061d-4cc0-925b-943eb85ef08f tempest-AttachVolumeTestJSON-297536414 None] Deleting attachment 54bfddea-c3a9-4d33-b489-39d7fe6d4e0c. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:08:07.009207 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6d11ce34-5a65-4ba1-8df4-76968924ef2a req-8a82cec7-8b50-45ad-b145-00153b6e3084 tempest-AttachVolumeTestJSON-297536414 None] Terminate volume connection completed successfully. Mar 26 21:08:07.015459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-6d11ce34-5a65-4ba1-8df4-76968924ef2a req-8a82cec7-8b50-45ad-b145-00153b6e3084 tempest-AttachVolumeTestJSON-297536414 None] Deleting attachment 6489bde2-3cda-45d3-84f4-8164b2bc6724. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:08:17.938203 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:18.009926 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:18.151482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:18.151482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:18.158526 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] deleting rbd volume volume-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:18.660705 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Created reservations ['486500da-f6ea-4a86-b55a-3910926decad', '2e8316ef-1de1-4532-806e-c28d258f3287', '7c09b86b-960a-497e-afe0-2a124c931e69', 'bb3d25e2-c5ca-4363-9d8d-650f39e94d9d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:18.792782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:18.851396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:18.910758 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:18.915430 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Deleted volume successfully. Mar 26 21:08:18.934911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7c7f19bc-3ca0-4b76-adf5-7a2391f706c0 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-0ae8f0ee-e556-44ed-afeb-a79fcba7ce64-delete_volume'" released by "delete_volume" :: held 1.000s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:19.332937 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-f610a18f-caa9-441d-a864-6de8abe1f502-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:19.468853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:19.564476 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:19.565171 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-f610a18f-caa9-441d-a864-6de8abe1f502 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:19.593930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] deleting rbd volume volume-f610a18f-caa9-441d-a864-6de8abe1f502 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:20.085310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Created reservations ['a7815a3f-c8a6-45e0-9cd8-40768602d039', '644936f0-9b2b-4e46-8c3c-c42cf60b56b0', 'b64ff31b-9a4c-4ca5-a07f-31145a353f98', '3642f582-e370-4c30-a66f-5719f1f6bfef'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:20.171717 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:20.241476 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:20.290546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:20.294667 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Deleted volume successfully. Mar 26 21:08:20.332248 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cb899168-5fe9-479b-8427-62aee97e6591 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-f610a18f-caa9-441d-a864-6de8abe1f502-delete_volume'" released by "delete_volume" :: held 0.999s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:20.810892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-b5bc46c5-266e-44bc-843e-b5f8243721f5-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:20.948126 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:21.075785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:21.076446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Volume volume-b5bc46c5-266e-44bc-843e-b5f8243721f5 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:21.095101 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] deleting rbd volume volume-b5bc46c5-266e-44bc-843e-b5f8243721f5 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:21.137039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:08:21.188051 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Flow 'volume_create_manager' (aa8643de-6c38-450a-9c12-a7d1abe1b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:21.206664 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd7de41-d3c2-4495-9c22-4c40915bc8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.236364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd7de41-d3c2-4495-9c22-4c40915bc8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1828535158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d64c72b9-5b2b-4479-9d50-fc26c071398c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6314ab85a88d4e189f6bd773093b8152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:08:21Z,use_quota=True,user_id='98f6f31825584a7ebc9b83ce6f26161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.243751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06902b39-8562-4453-8d41-669d30645fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.248622 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06902b39-8562-4453-8d41-669d30645fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.259489 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7953b98f-b7ca-4bd8-b3e4-017f19f087f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.264099 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7953b98f-b7ca-4bd8-b3e4-017f19f087f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64c72b9-5b2b-4479-9d50-fc26c071398c', 'volume_name': 'volume-d64c72b9-5b2b-4479-9d50-fc26c071398c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.270927 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35637599-f73c-4c04-9450-adbc4a8aec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.278209 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35637599-f73c-4c04-9450-adbc4a8aec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.288066 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea98c128-727f-4a72-bee8-c28c141b3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.289546 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Volume d64c72b9-5b2b-4479-9d50-fc26c071398c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64c72b9-5b2b-4479-9d50-fc26c071398c', 'volume_size': 1} Mar 26 21:08:21.290146 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] creating volume 'volume-d64c72b9-5b2b-4479-9d50-fc26c071398c' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:08:21.308808 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:21.502569 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:08:21.503093 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:08:21.507538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea98c128-727f-4a72-bee8-c28c141b3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64c72b9-5b2b-4479-9d50-fc26c071398c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.518436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164b425-7d5a-4d4e-984f-5d653879dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:21.545377 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Volume volume-d64c72b9-5b2b-4479-9d50-fc26c071398c (d64c72b9-5b2b-4479-9d50-fc26c071398c): created successfully Mar 26 21:08:21.553531 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164b425-7d5a-4d4e-984f-5d653879dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:21.571049 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Flow 'volume_create_manager' (aa8643de-6c38-450a-9c12-a7d1abe1b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:21.625641 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fd223dba-c054-4c27-a30f-644696735345 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Created volume successfully. Mar 26 21:08:21.693500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Created reservations ['1e9bdc5d-5110-4b94-af44-b5427afc93da', '7787088c-898c-4627-adc1-7d0880b7b264', '0711a984-029b-485a-a8b6-9369f1e4cad7', '7f0193da-c283-42f2-ba08-a55bda36b9b4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:21.788595 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:21.890434 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:21.960089 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:21.979009 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Deleted volume successfully. Mar 26 21:08:21.994929 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-aab75d3e-bdf5-432e-8c92-f984c6a26728 tempest-AttachVolumeTestJSON-297536414 None] Lock "b'cinder-b5bc46c5-266e-44bc-843e-b5f8243721f5-delete_volume'" released by "delete_volume" :: held 1.184s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:22.390818 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f665aad1-88e9-4a1d-a0a1-51ee340e16c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:23.174750 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f665aad1-88e9-4a1d-a0a1-51ee340e16c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Create snapshot completed successfully Mar 26 21:08:24.136879 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cd51c54a-8096-41f4-8842-8250a866c069 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Lock "b'cinder-80013b63-2614-4eee-a403-aeadf215025b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:24.138762 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cd51c54a-8096-41f4-8842-8250a866c069 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:25.308977 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-cd51c54a-8096-41f4-8842-8250a866c069 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Created reservations ['b14d4285-62bf-4b52-8f0f-e05d053ec74b', 'b2737bb5-d50a-439c-a3f5-faf481270adf', '6ee3a7e8-9aea-4b19-866d-f22430a37d5f', '9a551589-17ac-41ac-8449-e0ecaf5f04cf'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:25.421085 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-cd51c54a-8096-41f4-8842-8250a866c069 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Delete snapshot completed successfully. Mar 26 21:08:25.428997 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cd51c54a-8096-41f4-8842-8250a866c069 tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Lock "b'cinder-80013b63-2614-4eee-a403-aeadf215025b-delete_snapshot'" released by "delete_snapshot" :: held 1.291s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:25.859734 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 req-fc35b60b-6050-4e30-8b41-9722a6730a25 tempest-AttachVolumeShelveTestJSON-1677154310 None] No connector for attachment e01f41c9-f0e3-4c89-a4b0-3c9db4911e28; skipping storage backend terminate_connection call. {{(pid=134842) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}} Mar 26 21:08:25.863066 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 req-fc35b60b-6050-4e30-8b41-9722a6730a25 tempest-AttachVolumeShelveTestJSON-1677154310 None] Deleting attachment e01f41c9-f0e3-4c89-a4b0-3c9db4911e28. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:08:26.377608 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Lock "b'cinder-d64c72b9-5b2b-4479-9d50-fc26c071398c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:26.451038 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:26.535546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:26.536244 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Volume volume-d64c72b9-5b2b-4479-9d50-fc26c071398c is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:26.550858 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] deleting rbd volume volume-d64c72b9-5b2b-4479-9d50-fc26c071398c {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:27.101808 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Created reservations ['59b86bfa-665a-4dc6-8e92-8c8dff434397', 'b75a00b3-f3d5-413a-a4a2-da5cd977a851', '245df73f-cc67-42ca-a0ea-f7fdef5fd2b9', '5ff72830-1083-4285-9d3c-694189441e1d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:27.185578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:27.241801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:27.336386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:27.340762 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Deleted volume successfully. Mar 26 21:08:27.362988 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-47212fc1-b509-4ac3-ae3d-5db5445ff13d tempest-VolumeSnapshotQuotasNegativeTestJSON-1861765898 None] Lock "b'cinder-d64c72b9-5b2b-4479-9d50-fc26c071398c-delete_volume'" released by "delete_volume" :: held 0.985s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:48.647218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:08:48.681887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Flow 'volume_create_manager' (fce97785-6a3a-41a4-bed6-7ea7dd07b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:48.696998 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348fc04-4ef5-4dc5-94a7-9b1e2a3067b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:48.742787 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5348fc04-4ef5-4dc5-94a7-9b1e2a3067b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1841113552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f922f92-ca71-4a3b-9536-cbeeb848a13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c6849aa874b98b765ddbee781dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:08:49Z,use_quota=True,user_id='800a379a2a9a40a4b66109740909874f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:48.760546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e1d335-1f7e-4496-a5d4-caca9b847b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:48.768125 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e1d335-1f7e-4496-a5d4-caca9b847b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:48.781311 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb23d5ab-3998-4f9b-bbf8-32cf7715b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:48.790287 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb23d5ab-3998-4f9b-bbf8-32cf7715b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f922f92-ca71-4a3b-9536-cbeeb848a13b', 'volume_name': 'volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:48.801671 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0e172d-0030-437c-be61-bc95dc444394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:48.824777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0e172d-0030-437c-be61-bc95dc444394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:48.830181 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b85e6b9-a232-4e4d-bef4-eaa112001ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:48.831287 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume 7f922f92-ca71-4a3b-9536-cbeeb848a13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b', 'volume_size': 1} Mar 26 21:08:48.832063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] creating volume 'volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:08:48.832473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:49.002791 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:08:49.004226 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:08:49.012357 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b85e6b9-a232-4e4d-bef4-eaa112001ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:49.023871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1e2180-324c-4600-a9d2-99e686864fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:49.053414 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b (7f922f92-ca71-4a3b-9536-cbeeb848a13b): created successfully Mar 26 21:08:49.059711 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1e2180-324c-4600-a9d2-99e686864fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:49.074050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Flow 'volume_create_manager' (fce97785-6a3a-41a4-bed6-7ea7dd07b918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:49.087053 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2b94f3a5-8b0c-46ae-ae92-14331ad67337 tempest-VolumeQuotasAdminTestJSON-524006028 None] Created volume successfully. Mar 26 21:08:49.849294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Lock "b'cinder-7f922f92-ca71-4a3b-9536-cbeeb848a13b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:49.950067 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:50.033340 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:50.034934 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:50.051132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] deleting rbd volume volume-7f922f92-ca71-4a3b-9536-cbeeb848a13b {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:50.416647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Created reservations ['972f7009-cdee-44ea-9e8d-6bdaf99a1437', 'bcef27d3-b556-4ebf-8217-da1949f121a1', 'a20f6a88-fff1-4b06-9b54-68e127997821', '8bbc6927-e0f8-45d6-8876-5126de54edfe'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:50.505349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:50.588214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:50.659402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:50.667339 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Deleted volume successfully. Mar 26 21:08:50.694357 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-12a1915f-c8e3-45d7-bc26-c179228783ef tempest-VolumeQuotasAdminTestJSON-524006028 None] Lock "b'cinder-7f922f92-ca71-4a3b-9536-cbeeb848a13b-delete_volume'" released by "delete_volume" :: held 0.840s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:51.109420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:08:51.133798 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Flow 'volume_create_manager' (e57b5eef-1280-47da-b12f-49beae79ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:51.142418 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2462e79-3bc5-4d1f-8e2f-8051c47db18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.194951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2462e79-3bc5-4d1f-8e2f-8051c47db18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2021993625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c640c84f-cd7a-49a8-828f-7335df5a1b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283f04bcbb04e179915e4b52786ee15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:08:51Z,use_quota=True,user_id='8ed8d3c39e1043a995c8ff6e116a2944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.217294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad88dee-272a-4701-b4bb-922d67a5cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.238706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad88dee-272a-4701-b4bb-922d67a5cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.261766 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7709c5de-904a-435f-928e-85b2f1a81a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.274480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7709c5de-904a-435f-928e-85b2f1a81a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c640c84f-cd7a-49a8-828f-7335df5a1b8e', 'volume_name': 'volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.292555 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5256a7-86f6-4817-a7a3-08c31e6cf9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.317154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5256a7-86f6-4817-a7a3-08c31e6cf9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.353393 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8363d1a3-f8b8-45cf-9235-8888ef8e1018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.361039 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Volume c640c84f-cd7a-49a8-828f-7335df5a1b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e', 'volume_size': 1} Mar 26 21:08:51.361830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] creating volume 'volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:08:51.362782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:51.442396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Lock "b'cinder-af628bd3-b055-4def-b114-c56cacb63061-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:51.508274 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:08:51.509080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:08:51.516892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8363d1a3-f8b8-45cf-9235-8888ef8e1018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.524300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f3686-b12b-43bd-b1c1-514ece4151c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.545186 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Volume volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e (c640c84f-cd7a-49a8-828f-7335df5a1b8e): created successfully Mar 26 21:08:51.550789 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f3686-b12b-43bd-b1c1-514ece4151c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.558625 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Flow 'volume_create_manager' (e57b5eef-1280-47da-b12f-49beae79ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:51.566311 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:51.618493 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:51.618939 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Volume volume-af628bd3-b055-4def-b114-c56cacb63061 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:51.624735 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] deleting rbd volume volume-af628bd3-b055-4def-b114-c56cacb63061 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:51.628071 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c76295b8-bbef-41f2-b05c-ff4fae2bfbbd tempest-AbsoluteLimitsTests-1206257727 None] Created volume successfully. Mar 26 21:08:51.650650 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:08:51.676380 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Flow 'volume_create_manager' (7cd0a18d-453b-4be8-9134-984c5a99e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:51.683948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65568c0-9c39-4eae-8774-9be1463161a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.708154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65568c0-9c39-4eae-8774-9be1463161a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1762673106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=874cdb1e-2de0-4657-96ec-a1942ea68fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9c6849aa874b98b765ddbee781dadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:08:51Z,use_quota=True,user_id='800a379a2a9a40a4b66109740909874f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.715631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86acb0b7-da5e-400a-8484-d5d658ab6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.720983 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86acb0b7-da5e-400a-8484-d5d658ab6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.728197 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a76c12-6116-47e6-85d4-f43f36b16181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.735224 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a76c12-6116-47e6-85d4-f43f36b16181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874cdb1e-2de0-4657-96ec-a1942ea68fed', 'volume_name': 'volume-874cdb1e-2de0-4657-96ec-a1942ea68fed', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.742316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2505e8b8-7c20-481c-b5f9-275c27eff1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.747875 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2505e8b8-7c20-481c-b5f9-275c27eff1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.754157 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a695b96a-f1d0-4754-b9a7-9499898d312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.755760 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume 874cdb1e-2de0-4657-96ec-a1942ea68fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874cdb1e-2de0-4657-96ec-a1942ea68fed', 'volume_size': 1} Mar 26 21:08:51.756562 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] creating volume 'volume-874cdb1e-2de0-4657-96ec-a1942ea68fed' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:08:51.757754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:51.852172 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:08:51.852600 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:08:51.857740 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a695b96a-f1d0-4754-b9a7-9499898d312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874cdb1e-2de0-4657-96ec-a1942ea68fed', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.864022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c904079e-9b66-4642-aa32-6aef0cdd468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:51.874592 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Volume volume-874cdb1e-2de0-4657-96ec-a1942ea68fed (874cdb1e-2de0-4657-96ec-a1942ea68fed): created successfully Mar 26 21:08:51.879153 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c904079e-9b66-4642-aa32-6aef0cdd468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:51.887562 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Flow 'volume_create_manager' (7cd0a18d-453b-4be8-9134-984c5a99e61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:51.897426 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ed2cef3e-4fb0-4f0f-9561-c56e5a4ba003 tempest-VolumeQuotasAdminTestJSON-524006028 None] Created volume successfully. Mar 26 21:08:51.950140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Created reservations ['9074d02b-3d7d-430f-8d32-796e48f31e71', 'efdb9a3a-37d9-45ec-bf82-db5a2d282f44', '5d3880e5-c249-4264-b643-dcd61d221d47', 'ec566572-dc18-40e3-ac47-89d1d495dafb'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:52.009878 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:52.054138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:52.086265 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:52.094304 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Deleted volume successfully. Mar 26 21:08:52.113944 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Lock "b'cinder-c640c84f-cd7a-49a8-828f-7335df5a1b8e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:52.123299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-91b266db-bed2-4c92-afe0-7c9960515591 tempest-DeleteServersTestJSON-1584739936 None] Lock "b'cinder-af628bd3-b055-4def-b114-c56cacb63061-delete_volume'" released by "delete_volume" :: held 0.681s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:52.152138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:52.192868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:52.193486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Volume volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:52.199480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] deleting rbd volume volume-c640c84f-cd7a-49a8-828f-7335df5a1b8e {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:52.531619 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Created reservations ['9816df85-3d14-4c01-9fb6-708eb8820afc', '30e75195-6cba-4d2b-bdcf-93cee64b3039', 'c46e3c3e-36f9-43d9-a088-4959d4210ff6', '931cdb44-d3ff-4009-935b-0964215333ba'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:52.607697 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:52.670677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:52.725052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:52.730098 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Deleted volume successfully. Mar 26 21:08:52.749771 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27776bc5-2f0a-46d2-9049-6fca7275030b tempest-AbsoluteLimitsTests-1206257727 None] Lock "b'cinder-c640c84f-cd7a-49a8-828f-7335df5a1b8e-delete_volume'" released by "delete_volume" :: held 0.636s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:53.198122 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2e8edb7e-19c9-4e93-91de-aee681be36f9 tempest-VolumeQuotasAdminTestJSON-1725187655 None] Transfer volume completed successfully. Mar 26 21:08:53.700529 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Lock "b'cinder-874cdb1e-2de0-4657-96ec-a1942ea68fed-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:53.734176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:53.801035 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:53.801573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Volume volume-874cdb1e-2de0-4657-96ec-a1942ea68fed is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:53.807601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] deleting rbd volume volume-874cdb1e-2de0-4657-96ec-a1942ea68fed {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:08:54.110570 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Created reservations ['4dd862c6-7f7a-4263-ba66-fe95cec1181e', '31cf3d2b-b96e-44c2-b82a-d8eeab17b8a7', '31b5566e-1425-4388-b257-401e4f488526', '569369bb-ab44-4cff-9778-e48682b1f0d1'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:08:54.207236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:54.261111 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:54.295753 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:54.301059 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Deleted volume successfully. Mar 26 21:08:54.315321 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3228ba8b-e71f-4bd4-bce0-ce8e5c4da0fc tempest-VolumeQuotasAdminTestJSON-224028671 None] Lock "b'cinder-874cdb1e-2de0-4657-96ec-a1942ea68fed-delete_volume'" released by "delete_volume" :: held 0.615s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:08:57.593679 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:08:57.616919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Flow 'volume_create_manager' (e34c33be-62d7-426a-beca-ef5d5828f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:57.623773 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef6f7d9-10fe-42ff-bdb9-1463e55a07f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.640618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef6f7d9-10fe-42ff-bdb9-1463e55a07f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-377255761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e13479e7-cbe7-4b11-918f-14c731ca9941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8e9fac6cd148c5a144cbe642648a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:08:58Z,use_quota=True,user_id='e99d6eb023bd45aea7f232e3a2946cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.647076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d86d02-33cb-4ba1-b4c6-fcec1a465a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.651850 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d86d02-33cb-4ba1-b4c6-fcec1a465a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.657538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb73c9f-4e12-4073-bad9-114f4bd73818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.662435 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb73c9f-4e12-4073-bad9-114f4bd73818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13479e7-cbe7-4b11-918f-14c731ca9941', 'volume_name': 'volume-e13479e7-cbe7-4b11-918f-14c731ca9941', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.667580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a96e21c-406a-4380-ae26-4a755f001b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.672200 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a96e21c-406a-4380-ae26-4a755f001b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.677870 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4156b97b-d66d-4479-abe0-b3d7b1dad650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.679366 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Volume e13479e7-cbe7-4b11-918f-14c731ca9941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13479e7-cbe7-4b11-918f-14c731ca9941', 'volume_size': 1} Mar 26 21:08:57.679939 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] creating volume 'volume-e13479e7-cbe7-4b11-918f-14c731ca9941' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:08:57.681961 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:57.795186 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:08:57.795691 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:08:57.800925 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4156b97b-d66d-4479-abe0-b3d7b1dad650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13479e7-cbe7-4b11-918f-14c731ca9941', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.813399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b9d16-9fc4-40a9-bf7b-f19ae5fb66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:08:57.834268 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Volume volume-e13479e7-cbe7-4b11-918f-14c731ca9941 (e13479e7-cbe7-4b11-918f-14c731ca9941): created successfully Mar 26 21:08:57.841401 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b9d16-9fc4-40a9-bf7b-f19ae5fb66d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:08:57.853068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Flow 'volume_create_manager' (e34c33be-62d7-426a-beca-ef5d5828f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:08:57.884714 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4ea69878-c592-4a04-996c-56f08a934118 tempest-VolumesMetadataTest-1043769840 None] Created volume successfully. Mar 26 21:08:58.172036 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:08:58.173375 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:58.218439 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:58.263409 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:08:59.657234 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Lock "b'cinder-e13479e7-cbe7-4b11-918f-14c731ca9941-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:08:59.770265 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:08:59.956915 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:08:59.957801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Volume volume-e13479e7-cbe7-4b11-918f-14c731ca9941 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:08:59.974382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] deleting rbd volume volume-e13479e7-cbe7-4b11-918f-14c731ca9941 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:00.474236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Created reservations ['4ae1f3c7-943f-4c1d-9354-e75af6098818', '02fcd9af-f9d1-4b46-9ef6-938a260e5bce', '13ba9eca-3672-4f5b-b254-6a62637fc319', 'dd661f81-e3e1-40f9-b4c3-ca7d13e6f6a6'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:00.573729 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:00.638459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:00.695185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:00.701358 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Deleted volume successfully. Mar 26 21:09:00.718020 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a4479344-0a74-4310-89c5-c2489c8e0967 tempest-VolumesMetadataTest-1043769840 None] Lock "b'cinder-e13479e7-cbe7-4b11-918f-14c731ca9941-delete_volume'" released by "delete_volume" :: held 1.061s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:05.230264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:05.286943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Flow 'volume_create_manager' (84e5e4a5-e22a-4aea-8139-536aabc28737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:05.297160 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de746f92-8632-42ce-87e6-bca813b67de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.378994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de746f92-8632-42ce-87e6-bca813b67de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1448938569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c4252b7e-f24d-4bd7-a949-b9bfc3ded94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d333dbb48e416e88ee38a517995266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:05Z,use_quota=True,user_id='9c70dec99d4d462197189af39cdc6c07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66239220-fda8-46ca-bb3e-6294c2bc93ee),volume_type_id=66239220-fda8-46ca-bb3e-6294c2bc93ee)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.400141 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c54cad-1831-425f-b046-f8f1d9820438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.412892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c54cad-1831-425f-b046-f8f1d9820438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.429575 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6af1d-c4b4-445a-a8bd-5a3f84f27bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.440930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf6af1d-c4b4-445a-a8bd-5a3f84f27bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4252b7e-f24d-4bd7-a949-b9bfc3ded94a', 'volume_name': 'volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.450172 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bad69dd-7d7f-421d-8b8a-b7b3b0be87e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.465292 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bad69dd-7d7f-421d-8b8a-b7b3b0be87e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.480217 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6325a0bf-c713-4bf0-8a14-ef761385a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.484003 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Volume c4252b7e-f24d-4bd7-a949-b9bfc3ded94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a', 'volume_size': 1} Mar 26 21:09:05.484003 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] creating volume 'volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:05.484003 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:05.660322 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:05.660693 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:05.664422 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6325a0bf-c713-4bf0-8a14-ef761385a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.676384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8069e8-4407-460b-beb8-39867475760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.690670 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Volume volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a (c4252b7e-f24d-4bd7-a949-b9bfc3ded94a): created successfully Mar 26 21:09:05.694805 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8069e8-4407-460b-beb8-39867475760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.701006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Flow 'volume_create_manager' (84e5e4a5-e22a-4aea-8139-536aabc28737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:05.722375 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-bda858d6-1ce5-49ca-9b37-139f3cc080c8 tempest-VolumeTypesAccessTest-1247584751 None] Created volume successfully. Mar 26 21:09:05.742584 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:05.769821 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Flow 'volume_create_manager' (af3e8e36-e4a1-4e78-ab0d-e15a1bc2ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:05.778552 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa24c289-a9e0-479c-886f-89d96ddad464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.798806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa24c289-a9e0-479c-886f-89d96ddad464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-701972846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee76d1ab-6f43-41ff-ab83-be8282dc01ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8657daeb436044378b8b124a0f9d5c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:06Z,use_quota=True,user_id='9d7e99c126f3435ea890fa21c1614041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.804371 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844c42c-7fb6-4494-9490-108904455824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.812792 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844c42c-7fb6-4494-9490-108904455824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.818405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a086198-fad7-4f2f-a54f-f9ebba5eb8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.825773 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a086198-fad7-4f2f-a54f-f9ebba5eb8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'volume_name': 'volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.831490 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2c75bd-777e-48e4-b88e-2821b624c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.836928 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2c75bd-777e-48e4-b88e-2821b624c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.842140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dba3d2-6f05-49e2-b77c-16c83651e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:05.843823 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Volume ee76d1ab-6f43-41ff-ab83-be8282dc01ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'volume_size': 1} Mar 26 21:09:05.844409 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] creating volume 'volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:05.845858 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:05.980382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:05.981315 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:05.989689 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dba3d2-6f05-49e2-b77c-16c83651e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:05.999473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d59e570-44c3-4e56-bb4e-e58fa625e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:06.011794 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Volume volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad (ee76d1ab-6f43-41ff-ab83-be8282dc01ad): created successfully Mar 26 21:09:06.020507 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d59e570-44c3-4e56-bb4e-e58fa625e430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:06.030647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Flow 'volume_create_manager' (af3e8e36-e4a1-4e78-ab0d-e15a1bc2ce84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:06.050961 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-af3c2000-3f76-412b-8621-dcc58e60c87d tempest-VolumesBackupsV39Test-511055746 None] Created volume successfully. Mar 26 21:09:06.706387 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Lock "b'cinder-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:06.779203 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:06.884185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:06.884593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Volume volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:06.905723 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] deleting rbd volume volume-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:07.256373 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:09:06Z,data_timestamp=2022-03-26T21:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1135655536',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=16792d45-36c2-4f5c-9c44-f15f89a575d6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8657daeb436044378b8b124a0f9d5c15',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='9d7e99c126f3435ea890fa21c1614041',volume_id=ee76d1ab-6f43-41ff-ab83-be8282dc01ad) Mar 26 21:09:07.264890 ncdv-master-1 cinder-volume[134842]: INFO cinder.rpc [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Mar 26 21:09:07.274081 ncdv-master-1 cinder-volume[134842]: INFO cinder.rpc [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Mar 26 21:09:07.274911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] continue_backup in rpcapi backup_id 16792d45-36c2-4f5c-9c44-f15f89a575d6 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:09:07.379634 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1463420507 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1463420507, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:09:07.381308 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1463420507 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1463420507, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:09:07.405819 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Created reservations ['91935b53-91e4-41b8-a06d-0942964b69d7', 'aa20bed7-e898-4ec3-ae46-fcda17e5d7e1', 'e22fd4f2-27c7-4b7e-ba16-f14fd89e2567', 'bac9f6d1-3998-4ae5-ad60-c474187a992f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:07.468416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:07.522612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:07.606591 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:07.611210 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Deleted volume successfully. Mar 26 21:09:07.634365 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fcd45727-a6bb-4736-aff9-d2fa9f1d839d tempest-VolumeTypesAccessTest-1247584751 None] Lock "b'cinder-c4252b7e-f24d-4bd7-a949-b9bfc3ded94a-delete_volume'" released by "delete_volume" :: held 0.929s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:15.723110 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:09:16.958306 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.235s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:09:16.959132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'ee76d1ab-6f43-41ff-ab83-be8282dc01ad', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:09:16.991561 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Initialize volume connection completed successfully. Mar 26 21:09:21.486253 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:21.516083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (90c17233-487a-4cf9-b264-24694abe204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:21.525371 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07f26e4-c501-4283-8dd0-599ad36f1ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:21.546107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07f26e4-c501-4283-8dd0-599ad36f1ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-422384456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1e0e1a5-edb3-48a8-a377-46a9f8b4f398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a821ba46f3f5408ab82098a1d2d8a926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:21Z,use_quota=True,user_id='dd05073d7e52411c92d7b9def363dd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:21.552810 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad22238-f122-4dd8-bf73-c78d0f72e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:21.557682 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad22238-f122-4dd8-bf73-c78d0f72e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:21.564093 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f911967-1185-4f37-920a-176d491f8fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:21.631978 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Terminate volume connection completed successfully. Mar 26 21:09:21.752572 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-41ac08c9-7051-44d9-9508-8a4792a3e2b2 tempest-VolumesBackupsV39Test-511055746 None] Remove volume export completed successfully. Mar 26 21:09:21.795616 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f911967-1185-4f37-920a-176d491f8fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'volume_name': 'volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:21.803057 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819ff529-8eda-4841-bbc1-1242a7227ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:21.809495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819ff529-8eda-4841-bbc1-1242a7227ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:21.819060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647ec6b2-46fa-4d24-a053-db7dd50c7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:21.821330 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume a1e0e1a5-edb3-48a8-a377-46a9f8b4f398: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:09:21.822442 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Cloning a1e0e1a5-edb3-48a8-a377-46a9f8b4f398 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:09:21.833945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:21.861236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 9, 21, 839065)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:09:21.865917 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:09:21.866631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:09:21.873416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.039s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:21.885771 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:09:21.898769 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 9, 21, 895847)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:09:21.899985 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:09:21.900745 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:09:21.937103 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:22.093789 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] creating snapshot='volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:09:22.906285 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398.clone_snap' to 'volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:09:23.171342 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:23.172649 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:23.173164 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:23.206453 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:09:23.208154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Marking volume a1e0e1a5-edb3-48a8-a377-46a9f8b4f398 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:09:23.222140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to a1e0e1a5-edb3-48a8-a377-46a9f8b4f398. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:09:23.222834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Creating volume glance metadata for volume a1e0e1a5-edb3-48a8-a377-46a9f8b4f398 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:09:23.356696 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:23.388037 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Flow 'volume_create_manager' (56e11374-0a2a-4778-ab99-f5b17c916fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:23.401843 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f0a09e-1f6c-414d-9809-6049fa1be6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.411893 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647ec6b2-46fa-4d24-a053-db7dd50c7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.418954 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c539b00-62c6-4f3e-88b7-78a3fe616e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.443138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f0a09e-1f6c-414d-9809-6049fa1be6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1313900194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd5b321c-d921-4146-a7cc-06918399cf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6be6f8159f4491b83d9658d643464c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:23Z,use_quota=True,user_id='da090da7f121431abd13c9d9f0c71bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.450055 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b107a214-4084-4fee-9227-9a96c6ce6341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.455468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b107a214-4084-4fee-9227-9a96c6ce6341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.464815 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc91a9de-1e01-4cbf-b540-a92f88dd4f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.475751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc91a9de-1e01-4cbf-b540-a92f88dd4f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5b321c-d921-4146-a7cc-06918399cf42', 'volume_name': 'volume-cd5b321c-d921-4146-a7cc-06918399cf42', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.485048 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a73ee86-4966-44d7-bb22-7cc9341a5e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.498748 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a73ee86-4966-44d7-bb22-7cc9341a5e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.508586 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d92ab9c-236b-4118-af05-6607d25cab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.510707 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Volume cd5b321c-d921-4146-a7cc-06918399cf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5b321c-d921-4146-a7cc-06918399cf42', 'volume_size': 1} Mar 26 21:09:23.511294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] creating volume 'volume-cd5b321c-d921-4146-a7cc-06918399cf42' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:23.512139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:23.594944 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398 (a1e0e1a5-edb3-48a8-a377-46a9f8b4f398): created successfully Mar 26 21:09:23.602732 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c539b00-62c6-4f3e-88b7-78a3fe616e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.614708 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (90c17233-487a-4cf9-b264-24694abe204d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:23.647752 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f0ce8bb5-8d6d-42de-8ea6-1cbdab3e63c5 tempest-TaggedBootDevicesTest_v242-272398941 None] Created volume successfully. Mar 26 21:09:23.670113 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:23.671097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:23.677225 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d92ab9c-236b-4118-af05-6607d25cab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5b321c-d921-4146-a7cc-06918399cf42', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.689392 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e223bc91-a4fa-400a-9bc0-e360836c32e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:23.715543 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Volume volume-cd5b321c-d921-4146-a7cc-06918399cf42 (cd5b321c-d921-4146-a7cc-06918399cf42): created successfully Mar 26 21:09:23.726234 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e223bc91-a4fa-400a-9bc0-e360836c32e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:23.741717 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Flow 'volume_create_manager' (56e11374-0a2a-4778-ab99-f5b17c916fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:23.764211 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-acd5b613-a970-4e6d-97a9-afc1f62d11d6 tempest-VolumesActionsTest-989936466 None] Created volume successfully. Mar 26 21:09:24.359795 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:24.399428 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Flow 'volume_create_manager' (70636564-19ea-48dd-8bb5-22b635a202f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:24.415306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9130a2ec-0645-41b3-a044-68214d3d798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.478198 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9130a2ec-0645-41b3-a044-68214d3d798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945477993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=389ea347-fc4f-48d0-8559-7d60cce8e5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7d84d914bd48ddbd9e2801f8a9c616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:24Z,use_quota=True,user_id='102a4f93d75c4f219861f8e3e119fd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.495399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cac437-4afc-48ed-ba05-892f5e0e451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.506205 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cac437-4afc-48ed-ba05-892f5e0e451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.516779 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba3e12e-a687-48ca-af87-2846ce2ba6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.522045 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba3e12e-a687-48ca-af87-2846ce2ba6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389ea347-fc4f-48d0-8559-7d60cce8e5b8', 'volume_name': 'volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.530245 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1186ce-f0aa-43aa-a717-3ad676c1b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.536651 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1186ce-f0aa-43aa-a717-3ad676c1b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.542629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b8ec82-cf66-4103-91c4-c1e55a6137aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.550588 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Volume 389ea347-fc4f-48d0-8559-7d60cce8e5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8', 'volume_size': 1} Mar 26 21:09:24.551571 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] creating volume 'volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:24.551788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:24.767988 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:24.768817 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:24.774478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b8ec82-cf66-4103-91c4-c1e55a6137aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.780767 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f108797-fb16-4c92-96ad-1ddf9b687383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:24.800997 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Volume volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8 (389ea347-fc4f-48d0-8559-7d60cce8e5b8): created successfully Mar 26 21:09:24.809034 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f108797-fb16-4c92-96ad-1ddf9b687383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:24.823966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Flow 'volume_create_manager' (70636564-19ea-48dd-8bb5-22b635a202f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:24.852335 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9f913fcf-8045-4cf6-9ed5-482fc5a18443 tempest-ServersNegativeTestJSON-750347579 None] Created volume successfully. Mar 26 21:09:25.247626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:25.311063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (bee9d704-c4e3-44d7-92f6-b8fb7393426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:25.331029 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cd6ffa-c1df-498f-b852-0457c73427b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.393765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cd6ffa-c1df-498f-b852-0457c73427b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-945022839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df7e01bd-f149-463d-a824-e4f7814184a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a821ba46f3f5408ab82098a1d2d8a926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:25Z,use_quota=True,user_id='dd05073d7e52411c92d7b9def363dd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.411224 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e369c886-ef30-467d-87a2-e66c0f4165f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.426800 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e369c886-ef30-467d-87a2-e66c0f4165f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.446570 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adec6f80-2cc5-48ac-a606-3f2de8892975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.465599 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adec6f80-2cc5-48ac-a606-3f2de8892975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7e01bd-f149-463d-a824-e4f7814184a8', 'volume_name': 'volume-df7e01bd-f149-463d-a824-e4f7814184a8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.471854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a666e7-fb79-4b01-a4e9-7cdfe0fd1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.496647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a666e7-fb79-4b01-a4e9-7cdfe0fd1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.510052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39083e9-bac2-4092-a478-44cfadc7f421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.513723 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume df7e01bd-f149-463d-a824-e4f7814184a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7e01bd-f149-463d-a824-e4f7814184a8', 'volume_size': 1} Mar 26 21:09:25.514290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] creating volume 'volume-df7e01bd-f149-463d-a824-e4f7814184a8' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:25.515121 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:25.668732 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Lock "b'cinder-ee76d1ab-6f43-41ff-ab83-be8282dc01ad-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:25.689603 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:25.696386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:25.730909 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39083e9-bac2-4092-a478-44cfadc7f421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7e01bd-f149-463d-a824-e4f7814184a8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.775038 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5453f9c-fb57-413e-b72d-30c59f738d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:25.816985 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-df7e01bd-f149-463d-a824-e4f7814184a8 (df7e01bd-f149-463d-a824-e4f7814184a8): created successfully Mar 26 21:09:25.822136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5453f9c-fb57-413e-b72d-30c59f738d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:25.831079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (bee9d704-c4e3-44d7-92f6-b8fb7393426a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:25.908695 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0b87e956-4dac-40ca-b8a9-adb806f04278 tempest-TaggedBootDevicesTest_v242-272398941 None] Created volume successfully. Mar 26 21:09:25.919538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:27.017320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Volume volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:27.037025 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] deleting rbd volume volume-ee76d1ab-6f43-41ff-ab83-be8282dc01ad {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:27.412908 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:27.503029 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (98cf810b-6ff7-4f9d-b995-c5d0ae9c3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:27.525225 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5c69f7-a0c1-4cb0-b141-cba06807679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.577626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5c69f7-a0c1-4cb0-b141-cba06807679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-2119428885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b44bb35-eb1c-47f9-a3cc-cf492d4eea16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a821ba46f3f5408ab82098a1d2d8a926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:27Z,use_quota=True,user_id='dd05073d7e52411c92d7b9def363dd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.595595 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a5bc90-1b27-479a-b66f-ca7b76149686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.606124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a5bc90-1b27-479a-b66f-ca7b76149686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.622286 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0390899f-d9bd-4ceb-886e-1722879aa57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.637725 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0390899f-d9bd-4ceb-886e-1722879aa57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'volume_name': 'volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.659054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f2562-9667-4ce8-abe3-85ed247161b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.669215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f2562-9667-4ce8-abe3-85ed247161b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.674869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64995ce8-0b6e-4efc-b447-3c66ccfb443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.676295 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Volume 6b44bb35-eb1c-47f9-a3cc-cf492d4eea16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'volume_size': 1} Mar 26 21:09:27.676852 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] creating volume 'volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:27.677665 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:27.755388 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Created reservations ['9970fe3e-12c8-46f2-8246-1e6ca46020ed', '798df26a-b599-4c32-8117-6a7f250285c6', '6eb9656f-a521-423d-9d7b-12a25625d3fc', '1d941a53-93bc-4d11-8675-a09372d62d8b'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:27.785823 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:27.786289 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:27.793342 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64995ce8-0b6e-4efc-b447-3c66ccfb443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.825595 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3daf97-dbae-4f3e-b89a-b41fa0927fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:27.862739 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16 (6b44bb35-eb1c-47f9-a3cc-cf492d4eea16): created successfully Mar 26 21:09:27.867288 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3daf97-dbae-4f3e-b89a-b41fa0927fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:27.879836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Flow 'volume_create_manager' (98cf810b-6ff7-4f9d-b995-c5d0ae9c3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:27.932505 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1313f6e2-9418-488f-93b5-6fa41652010a tempest-TaggedBootDevicesTest_v242-272398941 None] Created volume successfully. Mar 26 21:09:28.043238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:28.175788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:28.265079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:28.270720 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Deleted volume successfully. Mar 26 21:09:28.305365 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b2d221d1-a679-4743-bdef-00ee02d1586f tempest-VolumesBackupsV39Test-511055746 None] Lock "b'cinder-ee76d1ab-6f43-41ff-ab83-be8282dc01ad-delete_volume'" released by "delete_volume" :: held 2.636s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:28.379307 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:28.456573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Flow 'volume_create_manager' (a4710524-c876-45b6-824c-acbe0c92afe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:28.479526 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837eb2f3-40ea-47fe-936e-e1c1ad716021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.556523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837eb2f3-40ea-47fe-936e-e1c1ad716021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1754264080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51b2c383-2ecd-4c2f-86be-29563fe98cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7d84d914bd48ddbd9e2801f8a9c616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:28Z,use_quota=True,user_id='102a4f93d75c4f219861f8e3e119fd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.566977 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f2b4c-59df-443a-b662-fb0156a93d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.585442 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f2b4c-59df-443a-b662-fb0156a93d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.623318 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0393b01a-662e-4f2c-b0ca-ac1e0e4cec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.637952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0393b01a-662e-4f2c-b0ca-ac1e0e4cec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b2c383-2ecd-4c2f-86be-29563fe98cfe', 'volume_name': 'volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.663838 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8bc6f9-b2b4-4e58-9438-3206835440d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.677949 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8bc6f9-b2b4-4e58-9438-3206835440d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.693376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e601c72-3971-4dd3-8b3c-a02b4de3a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.696890 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Volume 51b2c383-2ecd-4c2f-86be-29563fe98cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe', 'volume_size': 1} Mar 26 21:09:28.697413 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] creating volume 'volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:28.698241 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:28.890674 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:28.891615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:28.895498 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e601c72-3971-4dd3-8b3c-a02b4de3a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.915721 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2d8899-6b78-4821-bf0d-5fae9b3d0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:28.939893 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Volume volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe (51b2c383-2ecd-4c2f-86be-29563fe98cfe): created successfully Mar 26 21:09:28.966483 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2d8899-6b78-4821-bf0d-5fae9b3d0780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:28.985586 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Flow 'volume_create_manager' (a4710524-c876-45b6-824c-acbe0c92afe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:29.022356 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-10187662-61c8-4ed8-b10b-dccce73f965c tempest-ServersNegativeTestJSON-750347579 None] Created volume successfully. Mar 26 21:09:36.003757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:36.054069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (ee54611c-1c5c-4072-add5-a9842e57c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:36.072136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057ad28-901b-4638-8ec8-0ddcff0ea4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.102262 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057ad28-901b-4638-8ec8-0ddcff0ea4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-608758547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a23ee747-520b-4634-9881-38c91028bddf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='765e5efb645146e58c075fc2de2a13dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:36Z,use_quota=True,user_id='513a378e40574ca39833b2f1f80270e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.109369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047aea72-6eb8-4fde-9147-f10ad8e14658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.115791 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047aea72-6eb8-4fde-9147-f10ad8e14658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.132511 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9099eaa-5f28-476a-aa65-fd4408e2a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.145753 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9099eaa-5f28-476a-aa65-fd4408e2a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23ee747-520b-4634-9881-38c91028bddf', 'volume_name': 'volume-a23ee747-520b-4634-9881-38c91028bddf', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.154522 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd71d4d-2d14-42f4-b5b0-7eb45ccff12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.168306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd71d4d-2d14-42f4-b5b0-7eb45ccff12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.186016 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06440c5-a525-4a27-a4b1-5a82f7dc3923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.190983 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Volume a23ee747-520b-4634-9881-38c91028bddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23ee747-520b-4634-9881-38c91028bddf', 'volume_size': 1} Mar 26 21:09:36.191598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] creating volume 'volume-a23ee747-520b-4634-9881-38c91028bddf' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:36.192577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:36.299598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Lock "b'cinder-50c9d877-37d7-4744-84b6-2d9f0034a94d-delete_volume'" acquired by "delete_volume" :: waited 0.218s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:36.375905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:36.376830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:36.384209 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06440c5-a525-4a27-a4b1-5a82f7dc3923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23ee747-520b-4634-9881-38c91028bddf', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.395751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459ebec8-a248-4ee1-baba-4318cdb5576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:36.426404 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Volume volume-a23ee747-520b-4634-9881-38c91028bddf (a23ee747-520b-4634-9881-38c91028bddf): created successfully Mar 26 21:09:36.432161 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459ebec8-a248-4ee1-baba-4318cdb5576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:36.437839 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (ee54611c-1c5c-4072-add5-a9842e57c433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:36.457948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:36.571097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:36.571711 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume volume-50c9d877-37d7-4744-84b6-2d9f0034a94d is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:36.586871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] deleting rbd volume volume-50c9d877-37d7-4744-84b6-2d9f0034a94d {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:36.596935 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5ffccb91-cf4e-44d4-81b8-7309747e3e6f tempest-VolumesListTestJSON-194308023 None] Created volume successfully. Mar 26 21:09:37.153289 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Created reservations ['fad56325-6707-47a0-bba9-b2d6a682577e', '739555f2-2f12-448e-a5c0-ff84cea3c8e6', '0377cec4-5790-46d9-8ab0-52d907baff17', 'd323ade9-7730-4c08-bcae-17b5d375c6a4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:37.243593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:37.304602 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:37.393720 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:37.397838 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Deleted volume successfully. Mar 26 21:09:37.429712 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1748eb61-334d-43b3-b83c-9de69cf9a0bb tempest-AttachVolumeShelveTestJSON-1677154310 None] Lock "b'cinder-50c9d877-37d7-4744-84b6-2d9f0034a94d-delete_volume'" released by "delete_volume" :: held 1.125s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:37.878336 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:37.940786 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (5a54fd0e-cc2a-42cf-a4ab-0c28ee4fe3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:37.968247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee6151b-b9c0-45b0-9e88-8a554da85dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.029431 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee6151b-b9c0-45b0-9e88-8a554da85dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1668815762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b382519-fea1-40cb-96cf-4b7677eb5556,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='765e5efb645146e58c075fc2de2a13dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:38Z,use_quota=True,user_id='513a378e40574ca39833b2f1f80270e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.062687 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687e4fe-087a-44bd-871c-f9df46541d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.072634 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687e4fe-087a-44bd-871c-f9df46541d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.083083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabd5779-6884-466c-aad8-42e2bf9b3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.094042 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabd5779-6884-466c-aad8-42e2bf9b3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b382519-fea1-40cb-96cf-4b7677eb5556', 'volume_name': 'volume-6b382519-fea1-40cb-96cf-4b7677eb5556', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.099174 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c211fe5-dc94-41c9-8858-c43026e1ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.117888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c211fe5-dc94-41c9-8858-c43026e1ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.143154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3530ecad-5ae2-4e33-9035-c34e2e4a5fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.150444 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Volume 6b382519-fea1-40cb-96cf-4b7677eb5556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b382519-fea1-40cb-96cf-4b7677eb5556', 'volume_size': 1} Mar 26 21:09:38.151137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] creating volume 'volume-6b382519-fea1-40cb-96cf-4b7677eb5556' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:38.152166 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:38.308286 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:38.309372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:38.313936 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3530ecad-5ae2-4e33-9035-c34e2e4a5fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b382519-fea1-40cb-96cf-4b7677eb5556', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.318786 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36af96b2-82a7-4829-a5aa-1095323ef300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:38.349163 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Volume volume-6b382519-fea1-40cb-96cf-4b7677eb5556 (6b382519-fea1-40cb-96cf-4b7677eb5556): created successfully Mar 26 21:09:38.354630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36af96b2-82a7-4829-a5aa-1095323ef300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:38.361969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (5a54fd0e-cc2a-42cf-a4ab-0c28ee4fe3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:38.375334 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3db18d7d-285a-449c-abfb-79ec89bb82ad tempest-VolumesListTestJSON-194308023 None] Created volume successfully. Mar 26 21:09:38.578530 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Lock "b'cinder-575bb058-c5ae-4a01-831b-e61c0faaa551-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:38.699250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:38.799079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:38.799582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Volume volume-575bb058-c5ae-4a01-831b-e61c0faaa551 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:38.815502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] deleting rbd volume volume-575bb058-c5ae-4a01-831b-e61c0faaa551 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:39.337114 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Created reservations ['90349ac4-255e-410b-a14b-b3330de0e1e0', '5a9eb84f-ac2c-4e70-b283-36a7a67b5c1b', 'ca488440-535b-4eca-b135-1c764cd355bd', 'c9bff8f6-ce4b-467d-bf86-b2199ac8c817'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:39.486715 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:39.559496 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:39.636222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:39.641676 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Deleted volume successfully. Mar 26 21:09:39.664436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-294b6efc-e8e1-490d-8458-ce16b247de3c tempest-AttachVolumeShelveTestJSON-1677154310 None] Lock "b'cinder-575bb058-c5ae-4a01-831b-e61c0faaa551-delete_volume'" released by "delete_volume" :: held 1.086s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:39.782733 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:39.835954 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (dc2dcf88-6bd3-42c5-b320-6a5928f6a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:39.847701 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618eca1e-3a42-4dcd-9670-39c39a5b8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:39.908886 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618eca1e-3a42-4dcd-9670-39c39a5b8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1195158669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90710e5b-fd76-44f3-b2bb-5e20fd841b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='765e5efb645146e58c075fc2de2a13dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:40Z,use_quota=True,user_id='513a378e40574ca39833b2f1f80270e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:39.927583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5a2207-4349-4ae8-9c8a-1be8d02c40e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:39.944794 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5a2207-4349-4ae8-9c8a-1be8d02c40e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:39.959408 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba72af3-6099-4b6e-918a-02dd4e98eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:39.971848 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba72af3-6099-4b6e-918a-02dd4e98eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90710e5b-fd76-44f3-b2bb-5e20fd841b53', 'volume_name': 'volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:39.980052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5412e8e-64e9-4958-9ebd-c6b7c35cfa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:39.987613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5412e8e-64e9-4958-9ebd-c6b7c35cfa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:40.025701 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e8e80e-9321-42d4-85ef-1bc41146f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:40.030177 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Volume 90710e5b-fd76-44f3-b2bb-5e20fd841b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53', 'volume_size': 1} Mar 26 21:09:40.033046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] creating volume 'volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:40.034042 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:40.197702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:40.198083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:40.203814 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e8e80e-9321-42d4-85ef-1bc41146f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:40.208715 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f72f0f-9fec-45fe-9d39-3c6fc2c413d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:40.234771 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Volume volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53 (90710e5b-fd76-44f3-b2bb-5e20fd841b53): created successfully Mar 26 21:09:40.246450 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f72f0f-9fec-45fe-9d39-3c6fc2c413d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:40.255626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Flow 'volume_create_manager' (dc2dcf88-6bd3-42c5-b320-6a5928f6a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:40.269686 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0194e202-bb4c-4844-9a7b-375ccd115b13 tempest-VolumesListTestJSON-194308023 None] Created volume successfully. Mar 26 21:09:44.629065 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-90710e5b-fd76-44f3-b2bb-5e20fd841b53-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:44.713407 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:44.796367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:44.797320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Volume volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:44.815306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] deleting rbd volume volume-90710e5b-fd76-44f3-b2bb-5e20fd841b53 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:45.264919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Created reservations ['154c37ee-9061-4893-9750-d49bdf5c16a7', '41916f33-15a2-48bc-b52d-19ba694691c0', 'cd86e882-b6ed-44a0-8bb1-d3c6ee10e292', '3a548c71-a7e4-41dc-9aef-d68ce5d41376'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:45.347067 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:45.428997 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:45.488989 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:45.496674 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Deleted volume successfully. Mar 26 21:09:45.518305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-93aab7cf-1993-41ce-ae72-6e9a6a01c567 tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-90710e5b-fd76-44f3-b2bb-5e20fd841b53-delete_volume'" released by "delete_volume" :: held 0.889s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:45.851155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-6b382519-fea1-40cb-96cf-4b7677eb5556-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:45.920779 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:46.005700 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:46.006194 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Volume volume-6b382519-fea1-40cb-96cf-4b7677eb5556 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:46.033582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] deleting rbd volume volume-6b382519-fea1-40cb-96cf-4b7677eb5556 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:46.410449 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Created reservations ['debf1c4f-e908-40ba-9c44-90801829cba6', 'da77a5d8-f6ea-47c4-b368-d53c63acdbc0', 'fd5a0a21-1a01-4602-be35-af109024b7b1', 'a5f64ba9-2519-4c27-92eb-094a9d638399'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:46.488804 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:46.560782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:46.623781 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:46.629873 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Deleted volume successfully. Mar 26 21:09:46.646177 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1ad879fb-a63d-496b-bbb5-ef2072d0bb08 tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-6b382519-fea1-40cb-96cf-4b7677eb5556-delete_volume'" released by "delete_volume" :: held 0.795s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:47.030882 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-a23ee747-520b-4634-9881-38c91028bddf-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:47.118986 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:47.200706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:09:47.201129 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Volume volume-a23ee747-520b-4634-9881-38c91028bddf is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:09:47.221729 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] deleting rbd volume volume-a23ee747-520b-4634-9881-38c91028bddf {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:09:47.365569 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d68e53da-6ebf-482a-9217-52780ed7b948 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42'" acquired by "attach_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:47.484743 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d68e53da-6ebf-482a-9217-52780ed7b948 tempest-VolumesActionsTest-989936466 None] Attaching volume cd5b321c-d921-4146-a7cc-06918399cf42 to instance 4ab73749-55ca-4384-afe9-24e0335cf4bb at mountpoint /dev/sdb on host None. Mar 26 21:09:47.539892 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d68e53da-6ebf-482a-9217-52780ed7b948 tempest-VolumesActionsTest-989936466 None] Attach volume completed successfully. Mar 26 21:09:47.547405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d68e53da-6ebf-482a-9217-52780ed7b948 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42'" released by "attach_volume" :: held 0.182s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:47.677928 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Created reservations ['73e5fa5f-cb22-4a7a-a787-938f1990c797', '82db519d-2600-4f1a-824a-6152647f40f8', 'f22d31a9-9950-47f1-9046-5df90d852200', '10a6eace-12f3-4f3f-93c4-ef5024b97fa9'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:09:47.828211 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:47.919722 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:47.990494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:48.001526 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-4729db61-bb07-401c-8ee8-f5949595c70f tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-detach_volume'" acquired by "detach_volume" :: waited 0.261s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:09:48.002123 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4729db61-bb07-401c-8ee8-f5949595c70f tempest-VolumesActionsTest-989936466 None] Detaching volume cd5b321c-d921-4146-a7cc-06918399cf42 from instance 4ab73749-55ca-4384-afe9-24e0335cf4bb. Mar 26 21:09:48.021493 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Deleted volume successfully. Mar 26 21:09:48.062223 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-97658a6f-b47c-40b5-8617-04502bf4edbc tempest-VolumesListTestJSON-194308023 None] Lock "b'cinder-a23ee747-520b-4634-9881-38c91028bddf-delete_volume'" released by "delete_volume" :: held 1.031s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:48.100349 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4729db61-bb07-401c-8ee8-f5949595c70f tempest-VolumesActionsTest-989936466 None] Detach volume completed successfully. Mar 26 21:09:48.114398 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-4729db61-bb07-401c-8ee8-f5949595c70f tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-detach_volume'" released by "detach_volume" :: held 0.113s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:09:52.785604 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-326aed86-98a1-4795-9e7c-4a09e2712bcd tempest-TaggedBootDevicesTest_v242-272398941 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:09:53.748584 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-326aed86-98a1-4795-9e7c-4a09e2712bcd tempest-TaggedBootDevicesTest_v242-272398941 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.962s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:09:53.750890 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-30464410-b98e-433f-81e1-73d8e5024116 req-326aed86-98a1-4795-9e7c-4a09e2712bcd tempest-TaggedBootDevicesTest_v242-272398941 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:09:53.782868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-326aed86-98a1-4795-9e7c-4a09e2712bcd tempest-TaggedBootDevicesTest_v242-272398941 None] Connection info returned from driver {'name': 'volumes/volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a1e0e1a5-edb3-48a8-a377-46a9f8b4f398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fcab46d4-4b34-49e0-ae59-6155f63cdeba'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:09:53.898947 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-326aed86-98a1-4795-9e7c-4a09e2712bcd tempest-TaggedBootDevicesTest_v242-272398941 None] attachment_update completed successfully. Mar 26 21:09:54.075167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:09:54.141114 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (39c4dbcf-299c-4d5a-b834-23e5ca8b97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:54.157680 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05a01cd-ae70-477b-96fe-5419381ddd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.196540 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05a01cd-ae70-477b-96fe-5419381ddd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1681672620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1a81c96-3fa3-4167-be2b-3237aa8faf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:09:54Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.210158 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aac22e-d9d0-41ad-aaa0-2b0fb7077b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.218735 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aac22e-d9d0-41ad-aaa0-2b0fb7077b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.225657 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fbffab-3b09-4506-ac11-0239c52fb34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.231039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fbffab-3b09-4506-ac11-0239c52fb34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'volume_name': 'volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.238257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba14cd8-5f46-4587-a0db-f35f952ce6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.244459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba14cd8-5f46-4587-a0db-f35f952ce6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.250720 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e1198-a3cb-4afc-8e56-bfd131cae8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.252850 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume a1a81c96-3fa3-4167-be2b-3237aa8faf35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'volume_size': 1} Mar 26 21:09:54.253521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] creating volume 'volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:09:54.255453 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:54.437983 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-dd46bd1d-19e7-483a-8dc2-57f7a0c3ff41 tempest-TaggedBootDevicesTest_v242-272398941 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:09:54.521814 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:54.522211 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:54.528708 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e1198-a3cb-4afc-8e56-bfd131cae8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.539382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7543e4fd-a7b5-4a3f-9548-2dd2d65c9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:09:54.591052 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35 (a1a81c96-3fa3-4167-be2b-3237aa8faf35): created successfully Mar 26 21:09:54.608203 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7543e4fd-a7b5-4a3f-9548-2dd2d65c9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:09:54.625811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (39c4dbcf-299c-4d5a-b834-23e5ca8b97ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:09:54.645734 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-24726db7-2b49-4621-a0ab-96586cbeae95 tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:09:55.511462 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-77a5c21c-ded0-4b0f-ba47-03860d779df1 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:55.808635 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-dd46bd1d-19e7-483a-8dc2-57f7a0c3ff41 tempest-TaggedBootDevicesTest_v242-272398941 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.374s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:09:55.809300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-30464410-b98e-433f-81e1-73d8e5024116 req-dd46bd1d-19e7-483a-8dc2-57f7a0c3ff41 tempest-TaggedBootDevicesTest_v242-272398941 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df7e01bd-f149-463d-a824-e4f7814184a8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'df7e01bd-f149-463d-a824-e4f7814184a8', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:09:55.830607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-dd46bd1d-19e7-483a-8dc2-57f7a0c3ff41 tempest-TaggedBootDevicesTest_v242-272398941 None] Connection info returned from driver {'name': 'volumes/volume-df7e01bd-f149-463d-a824-e4f7814184a8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df7e01bd-f149-463d-a824-e4f7814184a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '60467e92-dd9e-4458-8e90-5ef893bab697'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:09:55.902570 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-dd46bd1d-19e7-483a-8dc2-57f7a0c3ff41 tempest-TaggedBootDevicesTest_v242-272398941 None] attachment_update completed successfully. Mar 26 21:09:56.348012 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-f74e36fa-18a2-4073-b644-2c62feb29fd5 tempest-TaggedBootDevicesTest_v242-272398941 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:09:56.842258 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-77a5c21c-ded0-4b0f-ba47-03860d779df1 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:09:57.382155 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-30464410-b98e-433f-81e1-73d8e5024116 req-f74e36fa-18a2-4073-b644-2c62feb29fd5 tempest-TaggedBootDevicesTest_v242-272398941 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.034s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:09:57.382849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-30464410-b98e-433f-81e1-73d8e5024116 req-f74e36fa-18a2-4073-b644-2c62feb29fd5 tempest-TaggedBootDevicesTest_v242-272398941 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:09:57.408354 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-f74e36fa-18a2-4073-b644-2c62feb29fd5 tempest-TaggedBootDevicesTest_v242-272398941 None] Connection info returned from driver {'name': 'volumes/volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6b44bb35-eb1c-47f9-a3cc-cf492d4eea16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9da94bc8-cfc3-4797-a744-67c6524c8836'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:09:57.471285 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-30464410-b98e-433f-81e1-73d8e5024116 req-f74e36fa-18a2-4073-b644-2c62feb29fd5 tempest-TaggedBootDevicesTest_v242-272398941 None] attachment_update completed successfully. Mar 26 21:09:58.084776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.driver [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Creating a new backup for volume volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35. {{(pid=134842) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Mar 26 21:09:58.164196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] cloning volumes/volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35@snapshot-25988537-311e-45e1-b94f-782168ebae7b to volume-9c60118f-0692-48ef-8ed1-39fa11bbbe87 {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:09:58.165886 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:58.218724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:58.283458 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:09:58.284782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:58.346849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:58.389295 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:09:58.447349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:09:58.448219 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:09:58.461012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:09:58.529276 ncdv-master-1 cinder-volume[134842]: WARNING cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Mar 26 21:09:58.582714 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:09:57Z,data_timestamp=2022-03-26T21:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-764574221',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ff7f4420-2114-4db6-bf7c-74de9ffea3d5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='25988537-311e-45e1-b94f-782168ebae7b',status='creating',temp_snapshot_id=None,temp_volume_id='9c60118f-0692-48ef-8ed1-39fa11bbbe87',updated_at=None,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_id=a1a81c96-3fa3-4167-be2b-3237aa8faf35) Mar 26 21:09:58.583811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] continue_backup in rpcapi backup_id ff7f4420-2114-4db6-bf7c-74de9ffea3d5 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:09:58.879672 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:09:59.751686 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.872s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:09:59.754505 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9c60118f-0692-48ef-8ed1-39fa11bbbe87', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '9c60118f-0692-48ef-8ed1-39fa11bbbe87', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:09:59.785350 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Initialize volume connection completed successfully. Mar 26 21:10:10.055000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eae23c33-d6d2-403c-99d8-c80affacf9d3 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42'" acquired by "attach_volume" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:10:10.166993 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-eae23c33-d6d2-403c-99d8-c80affacf9d3 tempest-VolumesActionsTest-989936466 None] Attaching volume cd5b321c-d921-4146-a7cc-06918399cf42 to instance 1f96df0b-e511-4023-85ee-46dff0a647e5 at mountpoint /dev/sdb on host None. Mar 26 21:10:10.222876 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-eae23c33-d6d2-403c-99d8-c80affacf9d3 tempest-VolumesActionsTest-989936466 None] Attach volume completed successfully. Mar 26 21:10:10.227574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eae23c33-d6d2-403c-99d8-c80affacf9d3 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42'" released by "attach_volume" :: held 0.172s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:10:10.673929 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-94a81589-ff8a-40e5-a263-7bf791dd9ed8 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-detach_volume'" acquired by "detach_volume" :: waited 0.027s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:10:10.674431 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94a81589-ff8a-40e5-a263-7bf791dd9ed8 tempest-VolumesActionsTest-989936466 None] Detaching volume cd5b321c-d921-4146-a7cc-06918399cf42 from instance 1f96df0b-e511-4023-85ee-46dff0a647e5. Mar 26 21:10:10.806128 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94a81589-ff8a-40e5-a263-7bf791dd9ed8 tempest-VolumesActionsTest-989936466 None] Detach volume completed successfully. Mar 26 21:10:10.817879 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-94a81589-ff8a-40e5-a263-7bf791dd9ed8 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-detach_volume'" released by "detach_volume" :: held 0.144s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:10:14.026362 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Terminate volume connection completed successfully. Mar 26 21:10:14.054758 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Remove volume export completed successfully. Mar 26 21:10:14.116023 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-9c60118f-0692-48ef-8ed1-39fa11bbbe87-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:10:14.131419 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:14.199812 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:10:14.208730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-9c60118f-0692-48ef-8ed1-39fa11bbbe87 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:10:14.607037 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:10:14.629216 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8c8edda3-6d19-4257-a2da-00e15d65adac tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-9c60118f-0692-48ef-8ed1-39fa11bbbe87-delete_volume'" released by "delete_volume" :: held 0.521s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:10:16.702363 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-74352825-1c71-454e-879a-0a2020e70d54 tempest-VolumesActionsTest-989936466 None] Running cmd (subprocess): rbd export --pool volumes volume-cd5b321c-d921-4146-a7cc-06918399cf42 /opt/stack/data/cinder/conversion/volume-cd5b321c-d921-4146-a7cc-06918399cf42-e4612f2c-bffb-4933-b7ac-3db12df5f660 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:10:17.871528 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-74352825-1c71-454e-879a-0a2020e70d54 tempest-VolumesActionsTest-989936466 None] CMD "rbd export --pool volumes volume-cd5b321c-d921-4146-a7cc-06918399cf42 /opt/stack/data/cinder/conversion/volume-cd5b321c-d921-4146-a7cc-06918399cf42-e4612f2c-bffb-4933-b7ac-3db12df5f660 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.169s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:10:17.887076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.image_utils [None req-74352825-1c71-454e-879a-0a2020e70d54 tempest-VolumesActionsTest-989936466 None] e4612f2c-bffb-4933-b7ac-3db12df5f660 was raw, no need to convert to raw {{(pid=134842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Mar 26 21:10:53.413951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74352825-1c71-454e-879a-0a2020e70d54 tempest-VolumesActionsTest-989936466 None] Uploaded volume to glance image-id: e4612f2c-bffb-4933-b7ac-3db12df5f660. {{(pid=134842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}} Mar 26 21:10:53.469164 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-74352825-1c71-454e-879a-0a2020e70d54 tempest-VolumesActionsTest-989936466 None] Copy volume to image completed successfully. Mar 26 21:10:54.195468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:10:54.270940 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (6b0cb2a7-b605-41d3-81d8-a1e2da113f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:10:54.306459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cadb02-bf6e-420f-a38e-d8d194dc341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:54.349348 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cadb02-bf6e-420f-a38e-d8d194dc341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-664698191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c90bcbd0-9a75-48e6-a516-481e089658af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:10:54Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:54.355074 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e0f444-fc6e-47ab-8e6a-91d3d2f2b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:54.399584 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e0f444-fc6e-47ab-8e6a-91d3d2f2b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:54.412140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3b5b3c-c621-43b7-a064-f575b311652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:55.635697 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:10:55.681294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3b5b3c-c621-43b7-a064-f575b311652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c90bcbd0-9a75-48e6-a516-481e089658af', 'volume_name': 'volume-c90bcbd0-9a75-48e6-a516-481e089658af', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:55.703412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c262c31b-0fa5-43b5-b46e-53f9729a737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:55.712943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c262c31b-0fa5-43b5-b46e-53f9729a737c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:55.734877 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c96f2e-960f-4f88-bf13-25d632fde88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:55.741272 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume c90bcbd0-9a75-48e6-a516-481e089658af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c90bcbd0-9a75-48e6-a516-481e089658af', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:10:55.742584 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Cloning c90bcbd0-9a75-48e6-a516-481e089658af from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:10:55.783451 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.039s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:10:55.837776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 10, 55, 798760)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:10:55.838494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:10:55.838902 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:10:55.851452 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.065s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:10:55.852285 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:10:55.885996 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:55.976149 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:10:55.976612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Volume volume-cd5b321c-d921-4146-a7cc-06918399cf42 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:10:55.986093 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] deleting rbd volume volume-cd5b321c-d921-4146-a7cc-06918399cf42 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:10:55.999616 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 10, 55, 861594)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:10:56.000067 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:10:56.000473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:10:56.031126 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:56.128518 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] creating snapshot='volume-c90bcbd0-9a75-48e6-a516-481e089658af.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:10:56.728189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-c90bcbd0-9a75-48e6-a516-481e089658af.clone_snap' to 'volume-c90bcbd0-9a75-48e6-a516-481e089658af' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:10:56.876601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Created reservations ['37b9c528-1079-49c7-a3f9-841aba109aa9', 'daab2276-5f85-4e48-8a96-add9de88f76d', 'b6689c62-7129-4777-8583-ff665db1e7ed', '74c074d1-16d3-4e10-bc45-5d8b48f59e66'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:10:56.972634 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:10:56.974420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:10:56.974873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:10:57.004298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:10:57.004971 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Marking volume c90bcbd0-9a75-48e6-a516-481e089658af as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:10:57.104892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to c90bcbd0-9a75-48e6-a516-481e089658af. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:10:57.106892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Creating volume glance metadata for volume c90bcbd0-9a75-48e6-a516-481e089658af backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:10:57.128233 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:57.218824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:57.295177 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:10:57.307488 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Deleted volume successfully. Mar 26 21:10:57.348662 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2a5b3f48-d353-4052-baa0-5c10f1d74bd2 tempest-VolumesActionsTest-989936466 None] Lock "b'cinder-cd5b321c-d921-4146-a7cc-06918399cf42-delete_volume'" released by "delete_volume" :: held 1.713s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:10:57.407172 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c96f2e-960f-4f88-bf13-25d632fde88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90bcbd0-9a75-48e6-a516-481e089658af', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:57.422851 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24c7849-feb2-4feb-9d2f-4dbc25316bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:10:57.447438 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-c90bcbd0-9a75-48e6-a516-481e089658af (c90bcbd0-9a75-48e6-a516-481e089658af): created successfully Mar 26 21:10:57.455963 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24c7849-feb2-4feb-9d2f-4dbc25316bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:10:57.480581 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (6b0cb2a7-b605-41d3-81d8-a1e2da113f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:10:57.514021 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f9a8490c-b40a-4464-b568-ffcdfd53f6a6 tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:10:58.287168 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:10:58.289152 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:58.374793 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:10:58.455868 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:10:59.334671 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 req-20d02c8c-35b4-4f53-b4b6-17ae967d7e80 tempest-VolumesSnapshotTestJSON-1730121226 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:11:00.798502 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 req-20d02c8c-35b4-4f53-b4b6-17ae967d7e80 tempest-VolumesSnapshotTestJSON-1730121226 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.463s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:11:00.800528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 req-20d02c8c-35b4-4f53-b4b6-17ae967d7e80 tempest-VolumesSnapshotTestJSON-1730121226 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c90bcbd0-9a75-48e6-a516-481e089658af', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'c90bcbd0-9a75-48e6-a516-481e089658af', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:11:00.873316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 req-20d02c8c-35b4-4f53-b4b6-17ae967d7e80 tempest-VolumesSnapshotTestJSON-1730121226 None] Connection info returned from driver {'name': 'volumes/volume-c90bcbd0-9a75-48e6-a516-481e089658af', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c90bcbd0-9a75-48e6-a516-481e089658af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '666202d5-3223-4800-99d0-7aaf8b451fdc'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:11:01.081633 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 req-20d02c8c-35b4-4f53-b4b6-17ae967d7e80 tempest-VolumesSnapshotTestJSON-1730121226 None] attachment_update completed successfully. Mar 26 21:11:02.950276 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:11:02.988778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (d14b987f-5584-46d3-aafb-8729ba3c3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:02.997656 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42fe1cf6-5108-4121-ab3c-7773ca2b51ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.015136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42fe1cf6-5108-4121-ab3c-7773ca2b51ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-821022852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f15536f9-5d63-4bc4-8237-4141ad30b570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13edcc6f41ce42ff8b88edb21a3ae4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:11:03Z,use_quota=True,user_id='579df559018e45808c3886ac22ecc165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.021460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e44f9d7-16ef-442c-8c91-373422c6c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.026319 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e44f9d7-16ef-442c-8c91-373422c6c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.034432 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18abfc66-d16c-494a-817a-be4f57fc52c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.040915 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18abfc66-d16c-494a-817a-be4f57fc52c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15536f9-5d63-4bc4-8237-4141ad30b570', 'volume_name': 'volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.047106 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3079594-8aa2-4c48-9b39-e8a38ff9c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.051752 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3079594-8aa2-4c48-9b39-e8a38ff9c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.057009 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7361e4b-c659-4c3f-885a-af00e7952379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.058400 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Volume f15536f9-5d63-4bc4-8237-4141ad30b570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'volume_size': 1} Mar 26 21:11:03.059162 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] creating volume 'volume-f15536f9-5d63-4bc4-8237-4141ad30b570' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:11:03.060584 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:03.156259 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:11:03.156638 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:11:03.162149 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7361e4b-c659-4c3f-885a-af00e7952379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.168402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f36c2-07b4-4ea5-aadc-c937aba04d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:03.181239 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Volume volume-f15536f9-5d63-4bc4-8237-4141ad30b570 (f15536f9-5d63-4bc4-8237-4141ad30b570): created successfully Mar 26 21:11:03.185403 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f36c2-07b4-4ea5-aadc-c937aba04d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:03.191782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (d14b987f-5584-46d3-aafb-8729ba3c3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:03.202439 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-235924e4-e362-4436-96c5-2b4c52ca4848 tempest-VolumesBackupsTest-1678098904 None] Created volume successfully. Mar 26 21:11:03.921583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-080d4928-803f-4075-8065-aebc04b470f9 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:04.801477 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-080d4928-803f-4075-8065-aebc04b470f9 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:11:05.297911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-01877e9e-3c06-4fb7-a41b-f9b199a82d6d tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:06.485520 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-01877e9e-3c06-4fb7-a41b-f9b199a82d6d tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:11:07.734556 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ee35c2b9-00e1-4054-887a-d504b734f785 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:08.497042 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ee35c2b9-00e1-4054-887a-d504b734f785 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:11:08.878355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-477411b9-aa05-4f4f-8d07-e0914222e841 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-8b8e2d22-60fa-4a19-8d71-df9f091e5fd3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:08.880063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-477411b9-aa05-4f4f-8d07-e0914222e841 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:27.163297 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 req-4eea58c9-cf06-4fcd-bf5d-f04fdfd3eae0 tempest-VolumesBackupsTest-1678098904 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:11:29.166222 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 req-4eea58c9-cf06-4fcd-bf5d-f04fdfd3eae0 tempest-VolumesBackupsTest-1678098904 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.002s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:11:29.168919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 req-4eea58c9-cf06-4fcd-bf5d-f04fdfd3eae0 tempest-VolumesBackupsTest-1678098904 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'f15536f9-5d63-4bc4-8237-4141ad30b570', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:11:29.230283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 req-4eea58c9-cf06-4fcd-bf5d-f04fdfd3eae0 tempest-VolumesBackupsTest-1678098904 None] Connection info returned from driver {'name': 'volumes/volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f15536f9-5d63-4bc4-8237-4141ad30b570', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f294beec-a7dd-45c6-8355-65281a6e3072'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:11:29.353895 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 req-4eea58c9-cf06-4fcd-bf5d-f04fdfd3eae0 tempest-VolumesBackupsTest-1678098904 None] attachment_update completed successfully. Mar 26 21:11:31.572801 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:11:31Z,data_timestamp=2022-03-26T21:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1782643102',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=516180f7-6a66-4457-8a3c-08aefebb3c78,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='13edcc6f41ce42ff8b88edb21a3ae4ec',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='579df559018e45808c3886ac22ecc165',volume_id=f15536f9-5d63-4bc4-8237-4141ad30b570) Mar 26 21:11:31.574059 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] continue_backup in rpcapi backup_id 516180f7-6a66-4457-8a3c-08aefebb3c78 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:11:31.801237 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:11:32.781825 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.982s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:11:32.783069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f15536f9-5d63-4bc4-8237-4141ad30b570', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'f15536f9-5d63-4bc4-8237-4141ad30b570', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:11:32.802547 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] Initialize volume connection completed successfully. Mar 26 21:11:34.922782 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] Terminate volume connection completed successfully. Mar 26 21:11:34.949307 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-94dfa0c1-a04b-4949-b775-7d58bc80cd55 tempest-VolumesBackupsTest-1678098904 None] Remove volume export completed successfully. Mar 26 21:11:38.972559 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 req-26e9ef17-d3cf-41ea-a36f-3ccd2e76270f tempest-VolumesBackupsTest-1678098904 None] Terminate volume connection completed successfully. Mar 26 21:11:38.973271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 req-26e9ef17-d3cf-41ea-a36f-3ccd2e76270f tempest-VolumesBackupsTest-1678098904 None] Deleting attachment f294beec-a7dd-45c6-8355-65281a6e3072. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:11:39.202004 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-477411b9-aa05-4f4f-8d07-e0914222e841 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['7e818b0c-1018-4214-bec7-19fb5f144f99', 'f6c599ab-9f07-4c20-a934-d9bb3ad1e12e', '6cb71943-0ae2-4104-8408-d00f408d8550', '76aa5264-455f-493b-83eb-403fe1a431a8'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:11:39.274730 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-477411b9-aa05-4f4f-8d07-e0914222e841 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:11:39.283064 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-477411b9-aa05-4f4f-8d07-e0914222e841 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-8b8e2d22-60fa-4a19-8d71-df9f091e5fd3-delete_snapshot'" released by "delete_snapshot" :: held 30.405s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:11:39.724218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-da9c67c3-945c-4b5f-a8ac-14f776172a56 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-9300f1d4-135d-4a63-a798-26e8c92ebaf7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:39.727664 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da9c67c3-945c-4b5f-a8ac-14f776172a56 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:43.345144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-f15536f9-5d63-4bc4-8237-4141ad30b570-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:43.397694 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:43.677792 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Volume volume-f15536f9-5d63-4bc4-8237-4141ad30b570 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:11:43.704871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] deleting rbd volume volume-f15536f9-5d63-4bc4-8237-4141ad30b570 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:11:44.161573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Created reservations ['85b63e7a-0640-4ae3-8b51-b97561959849', 'dad660fe-b1e9-4c5b-958f-b1028c0a7dbb', 'ea43db24-cc9a-4680-9389-ee55ff03f88f', '8292192d-3ab4-40c9-8009-8300a8d3a521'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:11:44.220815 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:44.281196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:44.321240 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:11:44.327815 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Deleted volume successfully. Mar 26 21:11:44.348082 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-138f4edb-6bf4-48f7-9064-dc813d762995 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-f15536f9-5d63-4bc4-8237-4141ad30b570-delete_volume'" released by "delete_volume" :: held 1.003s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:11:45.069283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:11:45.100418 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (7e1caf12-4fef-4b50-ba40-ef5b266df95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:45.111275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f769a2aa-952d-4041-ba59-2bcc8996d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:45.130482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f769a2aa-952d-4041-ba59-2bcc8996d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2025359602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50b33a17-1e04-41a5-bced-d5d91836b5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13edcc6f41ce42ff8b88edb21a3ae4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:11:45Z,use_quota=True,user_id='579df559018e45808c3886ac22ecc165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:45.141592 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667ec21d-dafc-4f02-baf0-df0f475d8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:45.147364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667ec21d-dafc-4f02-baf0-df0f475d8faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:45.155680 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099c0c5b-707c-4113-97df-06af7e479a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:45.287283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099c0c5b-707c-4113-97df-06af7e479a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50b33a17-1e04-41a5-bced-d5d91836b5d6', 'volume_name': 'volume-50b33a17-1e04-41a5-bced-d5d91836b5d6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:45.296455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8d6b11-fe5d-4fd9-bf40-d5d19d7d0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:45.302938 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8d6b11-fe5d-4fd9-bf40-d5d19d7d0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:45.309834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fd0b7c-9fe6-4270-83ce-b0698c6aada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:45.312085 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Volume 50b33a17-1e04-41a5-bced-d5d91836b5d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50b33a17-1e04-41a5-bced-d5d91836b5d6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:11:45.313139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Cloning 50b33a17-1e04-41a5-bced-d5d91836b5d6 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:11:45.327904 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:45.357574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 11, 45, 337064)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:11:45.358945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:11:45.359607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:11:45.367090 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.039s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:11:45.369393 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:11:45.394742 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 11, 45, 391812)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:11:45.400259 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:11:45.400714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:11:45.415179 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:45.512442 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] creating snapshot='volume-50b33a17-1e04-41a5-bced-d5d91836b5d6.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:11:46.548960 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-50b33a17-1e04-41a5-bced-d5d91836b5d6.clone_snap' to 'volume-50b33a17-1e04-41a5-bced-d5d91836b5d6' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:11:46.790620 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:11:46.792341 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:11:46.792883 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:11:46.842909 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:11:46.843832 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Marking volume 50b33a17-1e04-41a5-bced-d5d91836b5d6 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:11:46.856018 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 50b33a17-1e04-41a5-bced-d5d91836b5d6. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:11:46.856846 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Creating volume glance metadata for volume 50b33a17-1e04-41a5-bced-d5d91836b5d6 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:11:46.971027 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fd0b7c-9fe6-4270-83ce-b0698c6aada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b33a17-1e04-41a5-bced-d5d91836b5d6', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:46.987952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b021c62-2f80-4f03-a3fd-edaa6512262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:47.027194 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Volume volume-50b33a17-1e04-41a5-bced-d5d91836b5d6 (50b33a17-1e04-41a5-bced-d5d91836b5d6): created successfully Mar 26 21:11:47.032316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b021c62-2f80-4f03-a3fd-edaa6512262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:47.039399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (7e1caf12-4fef-4b50-ba40-ef5b266df95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:47.051880 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7bf204c9-2e02-40b5-91b7-18c7e08712f7 tempest-VolumesBackupsTest-1678098904 None] Created volume successfully. Mar 26 21:11:47.476448 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:11:47Z,data_timestamp=2022-03-26T21:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1480593260',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=302ef0ea-3207-4ba4-a502-e34966251e52,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='13edcc6f41ce42ff8b88edb21a3ae4ec',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='579df559018e45808c3886ac22ecc165',volume_id=50b33a17-1e04-41a5-bced-d5d91836b5d6) Mar 26 21:11:47.477933 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] continue_backup in rpcapi backup_id 302ef0ea-3207-4ba4-a502-e34966251e52 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:11:47.724767 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:11:48.518480 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.793s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:11:48.519776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50b33a17-1e04-41a5-bced-d5d91836b5d6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '50b33a17-1e04-41a5-bced-d5d91836b5d6', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:11:48.542344 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] Initialize volume connection completed successfully. Mar 26 21:11:53.038233 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Lock "b'cinder-51b2c383-2ecd-4c2f-86be-29563fe98cfe-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:53.124738 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:53.280322 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:11:53.280783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Volume volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:11:53.292436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] deleting rbd volume volume-51b2c383-2ecd-4c2f-86be-29563fe98cfe {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:11:55.285032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Created reservations ['f8a8fd30-cc97-4024-b492-c4ea42f3087a', 'bc516bc9-980a-40fa-822f-8e0c4483dcd6', '63cbf112-5a56-4031-8d3c-258e7a6a2ef3', 'c295adb0-0c58-47c5-803c-d061d9255e03'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:11:55.413973 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:55.484231 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:55.531638 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:11:55.543017 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Deleted volume successfully. Mar 26 21:11:55.567766 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-75bbc468-5df2-4bb4-b2b6-a2c2def222ad tempest-ServersNegativeTestJSON-750347579 None] Lock "b'cinder-51b2c383-2ecd-4c2f-86be-29563fe98cfe-delete_volume'" released by "delete_volume" :: held 2.529s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:11:56.467244 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Lock "b'cinder-389ea347-fc4f-48d0-8559-7d60cce8e5b8-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:11:56.526905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:56.635138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:11:56.636462 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Volume volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:11:56.751406 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] deleting rbd volume volume-389ea347-fc4f-48d0-8559-7d60cce8e5b8 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:11:57.340826 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Created reservations ['930a7c4b-6d86-4c1b-8f3f-3d2efaeb8b8d', '899e24fd-9222-4cdd-8121-228633b4a5d2', '0818d7d6-fd75-402b-a0eb-b2e86c4de3d4', 'edcb8d6d-31e9-483b-8538-255ca236eb1c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:11:57.386016 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] Terminate volume connection completed successfully. Mar 26 21:11:57.421587 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b7618356-f592-4a7d-88c8-f5e2a72c4606 tempest-VolumesBackupsTest-1678098904 None] Remove volume export completed successfully. Mar 26 21:11:57.485080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:57.555680 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:57.626834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:11:57.639158 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Deleted volume successfully. Mar 26 21:11:57.662327 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3a2559ad-86c2-4733-8f2f-efa23e707b1f tempest-ServersNegativeTestJSON-750347579 None] Lock "b'cinder-389ea347-fc4f-48d0-8559-7d60cce8e5b8-delete_volume'" released by "delete_volume" :: held 1.195s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:11:58.291052 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:11:58.293075 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:58.335094 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:58.366162 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:11:58.402107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:11:58.426319 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (1e27c41a-112a-4b77-b63b-92b17a7ae759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:58.434554 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c33134-41bf-4976-bfb1-38cdbc8b31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.453528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c33134-41bf-4976-bfb1-38cdbc8b31b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:11:58Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_302ef0ea-3207-4ba4-a502-e34966251e52',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=33e5349f-5622-44a1-843c-247b4e4d5d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13edcc6f41ce42ff8b88edb21a3ae4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:11:58Z,use_quota=True,user_id='579df559018e45808c3886ac22ecc165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.459630 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac7fb2-2973-4303-b242-87cba4136eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.464117 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac7fb2-2973-4303-b242-87cba4136eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.470592 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b8e8c-0bbd-4cef-8a1b-6bd30099c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.475291 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b8e8c-0bbd-4cef-8a1b-6bd30099c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e5349f-5622-44a1-843c-247b4e4d5d29', 'volume_name': 'volume-33e5349f-5622-44a1-843c-247b4e4d5d29', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.481714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44d312e-732f-4e8b-bc14-37ca0aa0e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.489926 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44d312e-732f-4e8b-bc14-37ca0aa0e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.498629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7816863a-cb0d-451c-93af-ffd69350089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.500138 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Volume 33e5349f-5622-44a1-843c-247b4e4d5d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e5349f-5622-44a1-843c-247b4e4d5d29', 'volume_size': 1} Mar 26 21:11:58.500899 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] creating volume 'volume-33e5349f-5622-44a1-843c-247b4e4d5d29' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:11:58.502047 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:11:58.603579 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:11:58.605019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:11:58.609388 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7816863a-cb0d-451c-93af-ffd69350089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e5349f-5622-44a1-843c-247b4e4d5d29', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.614714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d548e7-881b-45c7-a6b6-64172009a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:11:58.627158 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Volume volume-33e5349f-5622-44a1-843c-247b4e4d5d29 (33e5349f-5622-44a1-843c-247b4e4d5d29): created successfully Mar 26 21:11:58.631070 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d548e7-881b-45c7-a6b6-64172009a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:11:58.636976 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Flow 'volume_create_manager' (1e27c41a-112a-4b77-b63b-92b17a7ae759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:11:58.648057 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Created volume successfully. Mar 26 21:11:59.507275 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:12:00.283890 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.777s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:12:00.285486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-33e5349f-5622-44a1-843c-247b4e4d5d29', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '33e5349f-5622-44a1-843c-247b4e4d5d29', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:12:00.306778 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Initialize volume connection completed successfully. Mar 26 21:12:07.195960 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Terminate volume connection completed successfully. Mar 26 21:12:07.226775 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a666a704-5ade-4d97-805a-4a7affc21275 tempest-VolumesBackupsTest-1678098904 None] Remove volume export completed successfully. Mar 26 21:12:08.028991 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-33e5349f-5622-44a1-843c-247b4e4d5d29-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:08.075040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:08.564392 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Volume volume-33e5349f-5622-44a1-843c-247b4e4d5d29 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:08.612122 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] deleting rbd volume volume-33e5349f-5622-44a1-843c-247b4e4d5d29 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:09.471453 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Created reservations ['76b10a0a-5518-4487-9ab6-cd6e78dfd3d2', '806b1989-5a1e-4225-bf53-9070811ce5b1', 'c38d1651-5b7b-4368-9100-5502d13737d4', 'fdc84fa6-25ff-4851-8e6f-b29f1eb96414'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:09.554844 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:09.601582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:09.651484 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:09.661555 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Deleted volume successfully. Mar 26 21:12:09.683680 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-81a009ef-23c5-48a5-b4b4-f2f7a7ea8d2f tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-33e5349f-5622-44a1-843c-247b4e4d5d29-delete_volume'" released by "delete_volume" :: held 1.654s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:10.111062 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-da9c67c3-945c-4b5f-a8ac-14f776172a56 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['27596c74-4771-43e1-b209-2dcc533a4aec', '7106e972-f83a-4bbf-80b8-6eee9c9fb6a7', '879c11e2-3056-4953-a787-eafc51af5ee9', '32adfc86-48bd-42d5-8eb2-cc270e9bb4d4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:10.194622 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-da9c67c3-945c-4b5f-a8ac-14f776172a56 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:12:10.199617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-da9c67c3-945c-4b5f-a8ac-14f776172a56 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-9300f1d4-135d-4a63-a798-26e8c92ebaf7-delete_snapshot'" released by "delete_snapshot" :: held 30.476s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:11.278604 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d5143471-749a-44de-acf4-b3bc34afd1bb tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-25a9f487-4d4c-4c4e-b386-a79249386910-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:11.284757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d5143471-749a-44de-acf4-b3bc34afd1bb tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:13.601395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-50b33a17-1e04-41a5-bced-d5d91836b5d6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:13.667405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:14.627184 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] deleting rbd volume volume-50b33a17-1e04-41a5-bced-d5d91836b5d6 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:15.122436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:12:15.164631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] deleting parent snapshot volume-50b33a17-1e04-41a5-bced-d5d91836b5d6.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:12:15.672127 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] Created reservations ['ffbae7ff-2f55-43cc-9c7e-99ea004a9809', '18ddffed-5eac-436c-9904-4f38a915a6e8', 'bb5ec560-bc84-4369-8089-5ed3036b1290', '290a8ce2-9188-45c7-a833-073c51859c59'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:15.748455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:15.817050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:15.873780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:15.880168 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] Deleted volume successfully. Mar 26 21:12:15.898048 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-74f3cf5b-fd82-4328-a52d-a46fbee3caf3 tempest-VolumesBackupsTest-1678098904 None] Lock "b'cinder-50b33a17-1e04-41a5-bced-d5d91836b5d6-delete_volume'" released by "delete_volume" :: held 2.296s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:16.898659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:16.955970 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Flow 'volume_create_manager' (98e3a99e-1481-480f-8ae6-d5b7d3f026b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:16.965314 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444eabb-de0f-4b26-a573-805c6b1f1ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:16.983337 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444eabb-de0f-4b26-a573-805c6b1f1ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1830757743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdf65634074841f3ba68b540f7706a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:17Z,use_quota=True,user_id='30c538b3ad234ec89213e8676cedbedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:16.990911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a388985-2e36-40ee-8e31-e0a404a576ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:16.995855 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a388985-2e36-40ee-8e31-e0a404a576ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:17.001739 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d690d5a7-7eb2-4381-97dd-76efc87004f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:17.013087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d690d5a7-7eb2-4381-97dd-76efc87004f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c', 'volume_name': 'volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:17.018603 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b9b5a-27e4-4a7d-a77a-3942c654c6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:17.023533 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b9b5a-27e4-4a7d-a77a-3942c654c6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:17.030055 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea4c495-861b-4a6b-aa72-5e61fbeb683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:17.036316 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Volume 0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c', 'volume_size': 1} Mar 26 21:12:17.037172 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] creating volume 'volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:17.038007 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:17.199046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:17.200217 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:17.211887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea4c495-861b-4a6b-aa72-5e61fbeb683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:17.218769 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307d3033-f19c-47fb-8fe4-e203d6cbe9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:17.236208 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Volume volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c (0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c): created successfully Mar 26 21:12:17.245487 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307d3033-f19c-47fb-8fe4-e203d6cbe9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:17.252207 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Flow 'volume_create_manager' (98e3a99e-1481-480f-8ae6-d5b7d3f026b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:17.266969 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 req-b4f1230a-2e5b-4582-ae30-d10ec1c77159 tempest-VolumesGetTestJSON-1830149992 None] Created volume successfully. Mar 26 21:12:18.293552 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Lock "b'cinder-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c-delete_volume'" acquired by "delete_volume" :: waited 0.063s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:18.313581 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:18.348023 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (53f5b608-a04b-4552-ad35-7b5c6630c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:18.358983 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b4a8-f112-4e28-aab1-21fe6b71eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.378484 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7b4a8-f112-4e28-aab1-21fe6b71eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-452989232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:18Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.386753 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913b3be0-6483-475e-8552-69a52889de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.394112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913b3be0-6483-475e-8552-69a52889de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.402206 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9967b58-0e49-432f-b030-4922d392a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.409512 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9967b58-0e49-432f-b030-4922d392a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88', 'volume_name': 'volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.418855 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fc68b2-ce03-4bd9-915d-0271cd8fe01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.423312 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fc68b2-ce03-4bd9-915d-0271cd8fe01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.429948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892ab69-9e4f-4cba-8922-be2f4967a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.431383 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Volume 4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88', 'volume_size': 1} Mar 26 21:12:18.431966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] creating volume 'volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:18.432871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:18.519906 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:18.611327 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:18.611978 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Volume volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:18.620486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] deleting rbd volume volume-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:18.635662 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:18.636287 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:18.649766 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892ab69-9e4f-4cba-8922-be2f4967a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.658343 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f48439d-e1c1-4c6e-8d32-d1acf73fde15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:18.681758 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Volume volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88 (4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88): created successfully Mar 26 21:12:18.688896 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f48439d-e1c1-4c6e-8d32-d1acf73fde15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:18.699117 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (53f5b608-a04b-4552-ad35-7b5c6630c225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:18.710484 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-726996ea-b617-4df9-885b-946cf645a71a tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:19.034659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Created reservations ['3d90e1ae-39f8-43aa-b6a8-1a586ed10ed0', 'd73d0e88-45a3-4a6e-b8c9-2c1ccf0ae5ef', 'd3ab14cb-9857-4450-8945-30f94b97269b', 'd9eacf87-61f5-454a-bc06-872c0e38548d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:19.137390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:19.219334 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:19.313250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:19.317476 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Deleted volume successfully. Mar 26 21:12:19.340620 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-098a3bca-f6a3-4bd3-bad1-bfff1566408c req-7971f212-4ebe-477c-b7a8-9b8df8015360 tempest-VolumesGetTestJSON-1830149992 None] Lock "b'cinder-0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c-delete_volume'" released by "delete_volume" :: held 1.047s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:19.469091 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:19.512115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (88a9f13e-4f6f-45a0-bb99-4f14cca88bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:19.520154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d958625-f133-4c64-b846-65a2adea5e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.537599 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d958625-f133-4c64-b846-65a2adea5e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-398392567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e32deedb-a38c-4fdd-85c2-a35f8d222c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8e16658cc541b2976c9325d1558792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:19Z,use_quota=True,user_id='41ad4fbc224446efaf5ad85c8c87eeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.543710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b73c374-22df-4550-ab17-dfb37c1dd59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.549015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b73c374-22df-4550-ab17-dfb37c1dd59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.555439 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63900902-1571-4bcd-b5cb-757454507e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.560893 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63900902-1571-4bcd-b5cb-757454507e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'volume_name': 'volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.566268 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfe5a8c-c34f-4085-b36b-ec6573044437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.571116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfe5a8c-c34f-4085-b36b-ec6573044437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.578130 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e5b42d-cd3f-4725-9f32-30a01d445f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.580230 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Volume e32deedb-a38c-4fdd-85c2-a35f8d222c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'volume_size': 1} Mar 26 21:12:19.580934 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] creating volume 'volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:19.581877 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:19.691324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:19.691910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:19.698189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e5b42d-cd3f-4725-9f32-30a01d445f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.710881 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029c286c-da6f-40a4-81db-6dc789ac9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:19.729993 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58 (e32deedb-a38c-4fdd-85c2-a35f8d222c58): created successfully Mar 26 21:12:19.740000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029c286c-da6f-40a4-81db-6dc789ac9aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:19.750121 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (88a9f13e-4f6f-45a0-bb99-4f14cca88bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:19.779098 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-66acafc0-8f88-4424-8dee-7bca9b4eaa6d tempest-AttachVolumeNegativeTest-571250188 None] Created volume successfully. Mar 26 21:12:20.185003 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:20.206642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (3f4699c9-c6d0-4eff-9ef4-17aae340d343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:20.239836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e182ef78-b469-46d8-9ed4-34217b5cd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.284317 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e182ef78-b469-46d8-9ed4-34217b5cd869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876314458',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9cd22caa-4fa0-43c8-84c5-24e771cac673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:20Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.295080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9cfd45-c575-4246-98e8-ebd17aa48c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.304957 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9cfd45-c575-4246-98e8-ebd17aa48c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.321393 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7542044a-d580-45a3-a43c-58af8c9aab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.329465 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7542044a-d580-45a3-a43c-58af8c9aab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd22caa-4fa0-43c8-84c5-24e771cac673', 'volume_name': 'volume-9cd22caa-4fa0-43c8-84c5-24e771cac673', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.334935 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc52d2b7-0b69-425a-a9e2-8cdbcfc2320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.346923 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc52d2b7-0b69-425a-a9e2-8cdbcfc2320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.367368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7c4a71-dfce-47f7-b60a-1969e81825b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.368711 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Volume 9cd22caa-4fa0-43c8-84c5-24e771cac673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd22caa-4fa0-43c8-84c5-24e771cac673', 'volume_size': 1} Mar 26 21:12:20.371778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] creating volume 'volume-9cd22caa-4fa0-43c8-84c5-24e771cac673' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:20.372668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:20.563336 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:20.564332 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:20.568973 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7c4a71-dfce-47f7-b60a-1969e81825b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd22caa-4fa0-43c8-84c5-24e771cac673', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.580039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181b9dd-7994-4ac2-8e56-8cfdeec18a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:20.609733 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Volume volume-9cd22caa-4fa0-43c8-84c5-24e771cac673 (9cd22caa-4fa0-43c8-84c5-24e771cac673): created successfully Mar 26 21:12:20.615059 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181b9dd-7994-4ac2-8e56-8cfdeec18a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:20.635461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (3f4699c9-c6d0-4eff-9ef4-17aae340d343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:20.652835 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-106000e7-5e74-43f9-98e0-8a5b0487ffee tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:21.478863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-9cd22caa-4fa0-43c8-84c5-24e771cac673-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:21.548953 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-52c02b1f-1280-4d1f-9d4d-abf758c7092d req-c2ccbc54-e74f-4d8a-9d3a-10ff03346ad0 tempest-AttachVolumeNegativeTest-571250188 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:12:21.659349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:21.797201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:21.797461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Volume volume-9cd22caa-4fa0-43c8-84c5-24e771cac673 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:21.809646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-9cd22caa-4fa0-43c8-84c5-24e771cac673 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:22.301777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Created reservations ['ffd9176f-4ccb-4905-a259-24ab5c0bbf4a', '96165922-b8ad-4b3e-9c1d-1eb563f293bc', 'ff8019e7-4bcc-4171-b120-a4066053d4a7', 'b6c37dc1-c163-4377-ac60-e8f732655267'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:22.450455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:22.510720 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:22.642957 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:22.652850 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:22.676959 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-e70c73da-8fb4-461e-bbcd-b850f56521e1 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-9cd22caa-4fa0-43c8-84c5-24e771cac673-delete_volume'" released by "delete_volume" :: held 1.198s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:22.711182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:22.801900 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:22.909795 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:22.911299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Volume volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:22.929956 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:23.245735 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-52c02b1f-1280-4d1f-9d4d-abf758c7092d req-c2ccbc54-e74f-4d8a-9d3a-10ff03346ad0 tempest-AttachVolumeNegativeTest-571250188 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.697s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:12:23.246624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-52c02b1f-1280-4d1f-9d4d-abf758c7092d req-c2ccbc54-e74f-4d8a-9d3a-10ff03346ad0 tempest-AttachVolumeNegativeTest-571250188 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:12:23.280593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-52c02b1f-1280-4d1f-9d4d-abf758c7092d req-c2ccbc54-e74f-4d8a-9d3a-10ff03346ad0 tempest-AttachVolumeNegativeTest-571250188 None] Connection info returned from driver {'name': 'volumes/volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e32deedb-a38c-4fdd-85c2-a35f8d222c58', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5ace83d3-f230-4f66-bb87-b5a7803981f8'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:12:23.389254 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-52c02b1f-1280-4d1f-9d4d-abf758c7092d req-c2ccbc54-e74f-4d8a-9d3a-10ff03346ad0 tempest-AttachVolumeNegativeTest-571250188 None] attachment_update completed successfully. Mar 26 21:12:23.454138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Created reservations ['f6a080f2-d12d-49a5-848f-8cd8a1f717c9', 'cf38cc71-a070-4d48-9c9a-8ae59a8ce8bc', '69e959a3-ece7-4437-bb69-782405add375', '824ff469-1bdd-475d-95aa-96ee0676957d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:23.521695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:23.584854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:23.659408 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:23.676405 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:23.696483 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c73634a2-ed78-46ec-90b4-c7286c8fdb66 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-4a0fe0b8-2a39-4c27-b176-26b0a1b8ea88-delete_volume'" released by "delete_volume" :: held 0.985s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:24.433622 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:24.457918 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (900d0952-534a-4ef0-9876-6100fabad739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:24.468612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fe6616-1e8d-426d-9e58-811e8756f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.488426 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fe6616-1e8d-426d-9e58-811e8756f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-762136982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7d29905-4c92-4b6d-b08a-fa655cb695c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:24Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.499109 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50115aa-2e31-4ead-a333-bb86701aa8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.515402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50115aa-2e31-4ead-a333-bb86701aa8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.522440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdb1369-1c54-40b8-8fed-cf6dd9f79570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.528841 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdb1369-1c54-40b8-8fed-cf6dd9f79570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'volume_name': 'volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.543084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3891f654-ff3b-474a-93ce-44f190fe5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.563187 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3891f654-ff3b-474a-93ce-44f190fe5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.568406 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ca2dd6-ca20-41f0-88a5-63a9538bfed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.580502 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Volume f7d29905-4c92-4b6d-b08a-fa655cb695c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'volume_size': 1} Mar 26 21:12:24.581157 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] creating volume 'volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:24.581940 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:24.711166 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:24.711616 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:24.719737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ca2dd6-ca20-41f0-88a5-63a9538bfed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.735098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1674c57-a896-40cd-8425-6ad7d80df925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:24.770294 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Volume volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1 (f7d29905-4c92-4b6d-b08a-fa655cb695c1): created successfully Mar 26 21:12:24.775635 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1674c57-a896-40cd-8425-6ad7d80df925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:24.787439 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (900d0952-534a-4ef0-9876-6100fabad739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:24.807665 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5f70b653-29c7-407f-b243-e2a40d8e3bcc tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:26.112482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:26.169379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (135dae28-f8d3-4978-90d1-a0d6eafba5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:26.197318 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ac0c42-3624-4c60-b252-9fd76635a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.239365 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ac0c42-3624-4c60-b252-9fd76635a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2102037265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c92721b9-6058-4ba8-b4d5-87b7bb2f0d70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f7d29905-4c92-4b6d-b08a-fa655cb695c1,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:26Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:26.247837 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98433fbf-4301-4a36-a57f-8d5d80cdcab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.251677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98433fbf-4301-4a36-a57f-8d5d80cdcab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:26.257867 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ee1dda-edfa-463f-9ea4-200214127f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.281224 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ee1dda-edfa-463f-9ea4-200214127f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c92721b9-6058-4ba8-b4d5-87b7bb2f0d70', 'volume_name': 'volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70', 'volume_size': 1, 'source_volid': 'f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:26.291350 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1544f5-3cf9-44d9-825c-9b2c8e86ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.300268 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1544f5-3cf9-44d9-825c-9b2c8e86ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:26.309982 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753d6212-5edd-4763-92df-94dc85ac6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.311514 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Volume c92721b9-6058-4ba8-b4d5-87b7bb2f0d70: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70', 'volume_size': 1, 'source_volid': 'f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'source_volstatus': 'available'} Mar 26 21:12:26.332674 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:26.409619 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] creating snapshot='volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:12:26.731950 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] cloning 'volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1@volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70.clone_snap' to 'volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:12:26.921227 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Volume volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:26.924272 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:26.924648 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:26.960368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:12:26.967520 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753d6212-5edd-4763-92df-94dc85ac6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70', 'volume_size': 1, 'source_volid': 'f7d29905-4c92-4b6d-b08a-fa655cb695c1', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:26.974700 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7886d70-d0f8-45a8-a057-e79b0ee9f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:26.989907 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Volume volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70 (c92721b9-6058-4ba8-b4d5-87b7bb2f0d70): created successfully Mar 26 21:12:27.002281 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7886d70-d0f8-45a8-a057-e79b0ee9f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:27.035140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (135dae28-f8d3-4978-90d1-a0d6eafba5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:27.070452 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3177f18b-be95-4708-99de-0fd38947e004 tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:28.125612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:28.150731 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (68119e57-d110-4b2b-929f-ba795b2c79fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:28.159041 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0279dd82-3553-4512-bf30-f34a6ff0cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.181250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0279dd82-3553-4512-bf30-f34a6ff0cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1770010504',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b750106f-cd70-4d28-a758-0d95f6e6c2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:28Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.196174 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ca25d-4a9c-4f94-a4f8-b838d0780f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.207379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ca25d-4a9c-4f94-a4f8-b838d0780f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.213302 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6782094e-5796-48f7-9857-ecb1194230be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.217786 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6782094e-5796-48f7-9857-ecb1194230be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b750106f-cd70-4d28-a758-0d95f6e6c2ce', 'volume_name': 'volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.222839 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc71238-4d24-4e98-8a3f-565cb0094ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.227242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc71238-4d24-4e98-8a3f-565cb0094ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.232752 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02269fe-dc19-4d14-839b-a3cc089312d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.233858 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Volume b750106f-cd70-4d28-a758-0d95f6e6c2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce', 'volume_size': 1} Mar 26 21:12:28.234460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] creating volume 'volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:28.235690 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:28.339551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:28.340729 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:28.348164 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02269fe-dc19-4d14-839b-a3cc089312d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.359551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd72bc0d-2d1d-4a05-8190-cb256701d5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:28.372136 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Volume volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce (b750106f-cd70-4d28-a758-0d95f6e6c2ce): created successfully Mar 26 21:12:28.379488 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd72bc0d-2d1d-4a05-8190-cb256701d5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:28.388974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (68119e57-d110-4b2b-929f-ba795b2c79fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:28.402046 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-095bccaa-aa45-4b42-9341-45a5d8c0cd61 tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:29.307154 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-b750106f-cd70-4d28-a758-0d95f6e6c2ce-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:29.358678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:29.432739 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:29.433295 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Volume volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:29.441020 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-b750106f-cd70-4d28-a758-0d95f6e6c2ce {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:29.783967 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Created reservations ['20613dab-321d-4e14-b221-398671455a9c', '357e630a-4243-48b3-b033-a05f72939165', 'ddf2d88f-725d-45ce-9b33-a69ba332ef90', '53ce59e6-8875-4b68-b3cc-ae358d01a2e0'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:29.843930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:29.896611 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:29.978928 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:29.983275 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:30.010206 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-48f2ff6e-87ff-499a-b7f7-f8f9d4d6ed6c tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-b750106f-cd70-4d28-a758-0d95f6e6c2ce-delete_volume'" released by "delete_volume" :: held 0.703s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:30.532647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:30.575126 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:30.673740 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:30.688195 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:31.072372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:12:31.119000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Volume volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:31.119659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] deleting parent snapshot volume-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:12:31.897737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Created reservations ['a7dd0e71-5d28-4dfa-9910-1595d3acfe4d', '61b6031b-c0a4-4372-a9b8-04dd59b86803', '929e225a-8a0a-428c-a93c-00f13c9dd1e5', 'e9ed6906-5c7f-4c6e-a8fb-986b774e854f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:31.995996 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:32.067641 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:32.139908 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:32.153466 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:32.175019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7b2a9a75-11de-4117-9188-92fb13958509 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-c92721b9-6058-4ba8-b4d5-87b7bb2f0d70-delete_volume'" released by "delete_volume" :: held 1.642s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:33.714456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:33.745613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (788be770-d821-4d42-b25a-8a4261736cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:33.754143 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad56acf-6ede-4c9e-9885-ff39d6196262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:33.773560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad56acf-6ede-4c9e-9885-ff39d6196262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1720195603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c64b6ac-b9af-4cd2-9816-9fa6a0787145,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:34Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:33.780483 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059daf93-7fe7-40cd-88c1-3f0e9553e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:33.785068 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059daf93-7fe7-40cd-88c1-3f0e9553e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:33.793507 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9838fe-7004-44d3-86ed-ef43c9ab8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:33.879749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9838fe-7004-44d3-86ed-ef43c9ab8611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c64b6ac-b9af-4cd2-9816-9fa6a0787145', 'volume_name': 'volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:33.884887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c532b5f3-61bd-4bc7-b832-538f8d2b4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:33.888905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c532b5f3-61bd-4bc7-b832-538f8d2b4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:33.893836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5521274f-4f42-4656-8f92-38763376086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:33.894968 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Volume 1c64b6ac-b9af-4cd2-9816-9fa6a0787145: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:12:33.895534 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Cloning 1c64b6ac-b9af-4cd2-9816-9fa6a0787145 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:12:33.906975 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:33.917770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 12, 33, 911513)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:12:33.918475 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:12:33.918929 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:12:33.923367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:33.924363 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:12:33.929855 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 12, 33, 927619)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:12:33.930200 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:12:33.930643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:12:33.946376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:34.025148 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] creating snapshot='volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:12:34.874867 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145.clone_snap' to 'volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:12:35.109531 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:35.110684 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:35.111364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:35.150737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:12:35.151778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Marking volume 1c64b6ac-b9af-4cd2-9816-9fa6a0787145 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:12:35.167577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 1c64b6ac-b9af-4cd2-9816-9fa6a0787145. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:12:35.168377 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Creating volume glance metadata for volume 1c64b6ac-b9af-4cd2-9816-9fa6a0787145 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:12:35.300561 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5521274f-4f42-4656-8f92-38763376086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:35.305521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc679a5c-4c71-4856-94a1-6a2a4a12513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:35.318156 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Volume volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145 (1c64b6ac-b9af-4cd2-9816-9fa6a0787145): created successfully Mar 26 21:12:35.324779 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc679a5c-4c71-4856-94a1-6a2a4a12513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:35.336469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (788be770-d821-4d42-b25a-8a4261736cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:35.352960 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6517c857-62e3-4c92-b64f-202fe0c2df0d tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:36.726291 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:36.791574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (a6f7e2ad-4a98-4a34-8cb1-c8fc5cf3e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:36.821936 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5eae30-b2ea-4802-a613-7a9609af4171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:36.865333 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5eae30-b2ea-4802-a613-7a9609af4171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-957879952',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4332c9b-614e-4812-add9-53dcbe382312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d34e41144408c95c2b93cb797c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:37Z,use_quota=True,user_id='70b9b99519bd4335ab090702734a345b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:36.885811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc9577-8c01-4892-9e0d-97722ded603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:36.895317 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc9577-8c01-4892-9e0d-97722ded603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:36.904397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90352a0f-a078-4880-b131-a74fe817848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:36.910270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90352a0f-a078-4880-b131-a74fe817848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4332c9b-614e-4812-add9-53dcbe382312', 'volume_name': 'volume-a4332c9b-614e-4812-add9-53dcbe382312', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:36.920156 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cf0d50-fd6f-474a-8314-1cba47042f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:36.934040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cf0d50-fd6f-474a-8314-1cba47042f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:36.943250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbefe900-592a-4118-85bc-1ae8a01a05dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:36.945816 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Volume a4332c9b-614e-4812-add9-53dcbe382312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4332c9b-614e-4812-add9-53dcbe382312', 'volume_size': 1} Mar 26 21:12:36.946300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] creating volume 'volume-a4332c9b-614e-4812-add9-53dcbe382312' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:36.947666 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:37.120008 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:37.120667 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:37.125815 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbefe900-592a-4118-85bc-1ae8a01a05dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4332c9b-614e-4812-add9-53dcbe382312', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:37.136245 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca624b87-78a1-4613-b2fe-e01f6b7b3bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:37.164327 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Volume volume-a4332c9b-614e-4812-add9-53dcbe382312 (a4332c9b-614e-4812-add9-53dcbe382312): created successfully Mar 26 21:12:37.169062 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca624b87-78a1-4613-b2fe-e01f6b7b3bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:37.175011 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Flow 'volume_create_manager' (a6f7e2ad-4a98-4a34-8cb1-c8fc5cf3e345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:37.203335 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-036ee023-9a9f-4c31-8591-f9e049027440 tempest-VolumesGetTest-1691035315 None] Created volume successfully. Mar 26 21:12:37.886920 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-a4332c9b-614e-4812-add9-53dcbe382312-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:37.974412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:38.062237 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:38.062762 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Volume volume-a4332c9b-614e-4812-add9-53dcbe382312 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:38.076223 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-a4332c9b-614e-4812-add9-53dcbe382312 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:38.392163 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Created reservations ['79044de6-3160-4b22-8da7-87ae8f00dbed', '73ba150c-1d3d-41af-bea3-f4eeb25e2807', 'e999b2d4-e762-4ebd-848e-1e849925cd0b', 'ad86bd99-7662-4f81-94a8-f96d721bbf35'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:38.460606 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:38.531663 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:38.599504 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:38.606191 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:38.621234 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-84cd9c8c-6b74-4ae6-a557-8ca6ea582dba tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-a4332c9b-614e-4812-add9-53dcbe382312-delete_volume'" released by "delete_volume" :: held 0.738s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:39.084158 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-1c64b6ac-b9af-4cd2-9816-9fa6a0787145-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:39.128263 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:39.240118 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:39.252131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:39.589643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:12:39.649193 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] deleting parent snapshot volume-1c64b6ac-b9af-4cd2-9816-9fa6a0787145.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:12:39.982675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] Created reservations ['cc3af70f-1c6f-4754-ad9e-1f46e56542e9', 'ec1133ca-6d30-4622-9571-ae32e29f164a', '79d9e6ce-f814-4e80-b979-e2ce5d1ceb48', '2b339645-13cb-4106-ad26-9103406f3725'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:40.059795 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:40.113086 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:40.165919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:40.184355 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:40.205803 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3336dac2-c9cb-44e0-aeff-a17ca5d770a2 tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-1c64b6ac-b9af-4cd2-9816-9fa6a0787145-delete_volume'" released by "delete_volume" :: held 1.122s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:40.299577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-f7d29905-4c92-4b6d-b08a-fa655cb695c1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:40.374587 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:40.471612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:12:40.472063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Volume volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:12:40.482061 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] deleting rbd volume volume-f7d29905-4c92-4b6d-b08a-fa655cb695c1 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:12:40.880743 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Created reservations ['27f2e76f-ddbd-427f-90e7-ff219ad9fb72', 'aaa61da8-8720-4821-940d-4e19abaacd6f', 'a749b49f-cbf2-49c1-8ee3-c6a264db0eeb', '9a70c4d3-cf38-4c9f-ae4e-ae76d416b15b'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:40.978670 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:41.042785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:41.123121 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:41.132478 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Deleted volume successfully. Mar 26 21:12:41.149863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-24c4dd79-76ca-422e-8849-2da088eefdee tempest-VolumesGetTest-1691035315 None] Lock "b'cinder-f7d29905-4c92-4b6d-b08a-fa655cb695c1-delete_volume'" released by "delete_volume" :: held 0.850s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:41.630941 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-d5143471-749a-44de-acf4-b3bc34afd1bb tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['39defd5c-4bfa-4aa4-adc2-44c032c79843', '515280ce-38b8-4a4c-95ad-2c62a73a62f9', '69100bae-408f-43a6-8704-12b2e2fc841d', '40747f69-9068-4c9c-8e66-82e76345b5d9'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:41.753580 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d5143471-749a-44de-acf4-b3bc34afd1bb tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:12:41.760757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d5143471-749a-44de-acf4-b3bc34afd1bb tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-25a9f487-4d4c-4c4e-b386-a79249386910-delete_snapshot'" released by "delete_snapshot" :: held 30.482s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:42.970857 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 req-64bd36f2-295a-488a-8bc3-42424c84c866 tempest-VolumesSnapshotTestJSON-1730121226 None] Terminate volume connection completed successfully. Mar 26 21:12:42.971561 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 req-64bd36f2-295a-488a-8bc3-42424c84c866 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleting attachment 666202d5-3223-4800-99d0-7aaf8b451fdc. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:12:48.213898 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4e9479af-57ea-40f1-aae1-981474e68ab6 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:49.136000 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4e9479af-57ea-40f1-aae1-981474e68ab6 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:12:49.604773 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0350fd15-f55c-43c8-8635-d5b2c32f52e2 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-aaebc063-78ee-4111-8976-af23479976c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:12:49.625275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0350fd15-f55c-43c8-8635-d5b2c32f52e2 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:50.153455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-0350fd15-f55c-43c8-8635-d5b2c32f52e2 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['d15a5be7-c19d-4755-9941-ca80a95950a3', '3f740bbf-08ac-4cff-a629-085b5fc3b034', '9573acaf-9fc6-45c5-b796-cf1a2833e62e', '86ca25f3-43ab-4c71-ab1d-2a52eef35ca1'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:12:50.223041 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0350fd15-f55c-43c8-8635-d5b2c32f52e2 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:12:50.229932 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0350fd15-f55c-43c8-8635-d5b2c32f52e2 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-aaebc063-78ee-4111-8976-af23479976c3-delete_snapshot'" released by "delete_snapshot" :: held 0.625s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:12:51.061414 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-92dac5ed-fcfc-4f0e-93fe-5dfd1305bac7 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:52.190111 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-92dac5ed-fcfc-4f0e-93fe-5dfd1305bac7 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:12:58.288219 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:12:58.290112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:58.352293 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:58.414521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:12:59.143107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:12:59.172656 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Flow 'volume_create_manager' (bbc75aab-bd8a-4076-8984-7b98e600183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:59.181675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549c72c6-2c69-4f76-9b30-34e54ea1b643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.199092 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549c72c6-2c69-4f76-9b30-34e54ea1b643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1095752289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bd452d5-62f5-482e-a4df-d0aec36f3f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ec1467add04a35afa59444b1f51296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:12:59Z,use_quota=True,user_id='aea79da16ff648a2ac334d901a057785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.205144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5666f93-f9f9-4b15-ae26-793face8361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.211487 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5666f93-f9f9-4b15-ae26-793face8361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.217581 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91f98d-d3c9-46fa-8e97-fd401334ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.222085 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91f98d-d3c9-46fa-8e97-fd401334ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd452d5-62f5-482e-a4df-d0aec36f3f73', 'volume_name': 'volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.227834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8701b63-ad0e-4bfd-849c-d2daba807e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.233203 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8701b63-ad0e-4bfd-849c-d2daba807e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.238402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1b64da-c387-4fec-aec7-e8d6adb87396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.239550 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Volume 0bd452d5-62f5-482e-a4df-d0aec36f3f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73', 'volume_size': 1} Mar 26 21:12:59.240157 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] creating volume 'volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:12:59.241140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:12:59.374183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:12:59.374757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:12:59.378433 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1b64da-c387-4fec-aec7-e8d6adb87396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.384328 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e0ba80-b570-46de-9df3-98077c0c5061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:12:59.396721 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Volume volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73 (0bd452d5-62f5-482e-a4df-d0aec36f3f73): created successfully Mar 26 21:12:59.405317 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e0ba80-b570-46de-9df3-98077c0c5061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:12:59.413390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Flow 'volume_create_manager' (bbc75aab-bd8a-4076-8984-7b98e600183c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:12:59.425621 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d9d64c50-9cd4-4042-95e2-bf37462fda15 tempest-SnapshotsActionsTest-1968433713 None] Created volume successfully. Mar 26 21:13:00.493608 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-735d9cb8-1cbd-4baf-b54f-b025f48d8bdc tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:01.737494 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-735d9cb8-1cbd-4baf-b54f-b025f48d8bdc tempest-SnapshotsActionsTest-1968433713 None] Create snapshot completed successfully Mar 26 21:13:03.345783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-583c6ac0-0191-4719-acb4-7bfdf81210f9 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:03.795646 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-583c6ac0-0191-4719-acb4-7bfdf81210f9 tempest-SnapshotsActionsTest-1968433713 None] Create snapshot completed successfully Mar 26 21:13:04.603407 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b5ab96ca-9ac2-4f5a-97b4-f3145c3084a8 tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-4af4ca0b-9e12-4717-8a7a-8aa2df7514f2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:04.604869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b5ab96ca-9ac2-4f5a-97b4-f3145c3084a8 tempest-SnapshotsActionsTest-2062256506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:05.858395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b5ab96ca-9ac2-4f5a-97b4-f3145c3084a8 tempest-SnapshotsActionsTest-2062256506 None] Created reservations ['99459d4e-d52c-4458-b0bf-531009cce438', 'c78fa81a-6657-4425-95e1-db4be77e939f', '307f6d15-88c4-4ffe-bf43-d181e0ce0965', '3682625b-c7aa-4db0-b822-cb186d505b1c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:05.902529 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b5ab96ca-9ac2-4f5a-97b4-f3145c3084a8 tempest-SnapshotsActionsTest-2062256506 None] Delete snapshot completed successfully. Mar 26 21:13:05.909131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b5ab96ca-9ac2-4f5a-97b4-f3145c3084a8 tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-4af4ca0b-9e12-4717-8a7a-8aa2df7514f2-delete_snapshot'" released by "delete_snapshot" :: held 1.306s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:07.151812 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-42d9ef9e-b9c5-4e10-82e6-ff43bf0d3937 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:07.870725 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-42d9ef9e-b9c5-4e10-82e6-ff43bf0d3937 tempest-SnapshotsActionsTest-1968433713 None] Create snapshot completed successfully Mar 26 21:13:08.358570 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2d5b7e8c-7f2f-4943-821b-a69da8807afa tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-fbb6f434-9fcb-4b1c-b046-7c529eccee4c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:08.361066 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2d5b7e8c-7f2f-4943-821b-a69da8807afa tempest-SnapshotsActionsTest-2062256506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:08.903515 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-2d5b7e8c-7f2f-4943-821b-a69da8807afa tempest-SnapshotsActionsTest-2062256506 None] Created reservations ['4ca57b20-0512-47a5-a523-70afa7e3c369', 'e9fd0c15-34f6-4f1f-b954-3874ed925891', 'e266d2f2-cb3c-4072-8b24-31b1d8633685', '51d334e6-4626-4019-a41a-0dccbf3aa31d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:09.006138 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2d5b7e8c-7f2f-4943-821b-a69da8807afa tempest-SnapshotsActionsTest-2062256506 None] Delete snapshot completed successfully. Mar 26 21:13:09.029089 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2d5b7e8c-7f2f-4943-821b-a69da8807afa tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-fbb6f434-9fcb-4b1c-b046-7c529eccee4c-delete_snapshot'" released by "delete_snapshot" :: held 0.670s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:09.672099 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e47733a0-797d-4761-aae0-4972072adba2 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:09.875425 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e47733a0-797d-4761-aae0-4972072adba2 tempest-SnapshotsActionsTest-1968433713 None] Create snapshot completed successfully Mar 26 21:13:10.900250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a40df0f1-e147-4ecf-9dad-f24c4b380ec5 tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-2df5c157-e084-4c51-a0c0-7adf28acc3ef-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:10.920332 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a40df0f1-e147-4ecf-9dad-f24c4b380ec5 tempest-SnapshotsActionsTest-2062256506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:11.958749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a40df0f1-e147-4ecf-9dad-f24c4b380ec5 tempest-SnapshotsActionsTest-2062256506 None] Created reservations ['c1aa2843-8b94-4890-95c3-d28e28255448', '8d4660ca-20e8-40d7-b0a0-99171d162952', '4635b014-14f0-4079-8870-b7426ddce14f', '7779d858-68a2-4a86-bab2-a7830441d0af'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:12.018486 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a40df0f1-e147-4ecf-9dad-f24c4b380ec5 tempest-SnapshotsActionsTest-2062256506 None] Delete snapshot completed successfully. Mar 26 21:13:12.026928 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a40df0f1-e147-4ecf-9dad-f24c4b380ec5 tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-2df5c157-e084-4c51-a0c0-7adf28acc3ef-delete_snapshot'" released by "delete_snapshot" :: held 1.126s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:13.031487 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 req-43c5ac95-429c-408a-ac96-c53b04205aa2 tempest-VolumesSnapshotTestJSON-1730121226 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:13:13.627046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f1ca3c6a-94e8-45dc-8309-4f4bc02a8c6e tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:14.052557 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f1ca3c6a-94e8-45dc-8309-4f4bc02a8c6e tempest-SnapshotsActionsTest-1968433713 None] Create snapshot completed successfully Mar 26 21:13:14.175027 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 req-43c5ac95-429c-408a-ac96-c53b04205aa2 tempest-VolumesSnapshotTestJSON-1730121226 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.144s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:13:14.176012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 req-43c5ac95-429c-408a-ac96-c53b04205aa2 tempest-VolumesSnapshotTestJSON-1730121226 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:13:14.228156 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 req-43c5ac95-429c-408a-ac96-c53b04205aa2 tempest-VolumesSnapshotTestJSON-1730121226 None] Connection info returned from driver {'name': 'volumes/volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a1a81c96-3fa3-4167-be2b-3237aa8faf35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '520fe01a-891e-4e16-b6a1-121e9d8a760a'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:13:14.289106 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 req-43c5ac95-429c-408a-ac96-c53b04205aa2 tempest-VolumesSnapshotTestJSON-1730121226 None] attachment_update completed successfully. Mar 26 21:13:14.826850 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-405b1159-3bba-4f93-ae8b-e9fbc526527d tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-066bc633-0eba-4501-9974-40de49dc358f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:14.828315 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-405b1159-3bba-4f93-ae8b-e9fbc526527d tempest-SnapshotsActionsTest-2062256506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:15.739030 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-405b1159-3bba-4f93-ae8b-e9fbc526527d tempest-SnapshotsActionsTest-2062256506 None] Created reservations ['359e5afe-251a-43fa-843d-f85ca4189037', '270d4502-471b-4495-a2d4-89e036b9497e', 'b7bbe5fb-ca37-4029-bc23-3cbf99a76f2f', '7dd9a14f-36b4-4fd4-b863-7cf6a6975538'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:15.789557 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-405b1159-3bba-4f93-ae8b-e9fbc526527d tempest-SnapshotsActionsTest-2062256506 None] Delete snapshot completed successfully. Mar 26 21:13:15.795841 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-405b1159-3bba-4f93-ae8b-e9fbc526527d tempest-SnapshotsActionsTest-2062256506 None] Lock "b'cinder-066bc633-0eba-4501-9974-40de49dc358f-delete_snapshot'" released by "delete_snapshot" :: held 0.969s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:16.595641 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-04dbda33-0159-4116-907e-53c3edce7ee0 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:16.699607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8e67f97e-19d4-406d-8cdb-b369d9c7b71a tempest-SnapshotsActionsTest-1968433713 None] Lock "b'cinder-1cb05396-6090-4f70-ac58-742ca5567a35-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.150s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:16.702287 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8e67f97e-19d4-406d-8cdb-b369d9c7b71a tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:17.190273 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-04dbda33-0159-4116-907e-53c3edce7ee0 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:13:17.229069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8e67f97e-19d4-406d-8cdb-b369d9c7b71a tempest-SnapshotsActionsTest-1968433713 None] Created reservations ['3c989e7c-d1f9-42d0-a27a-3d7e4703c6c4', '1656048c-eb1e-43a1-84f8-3a0ff16b6066', 'b8325ebd-3c76-43fe-b581-a19f930cadf0', '9b1982c8-d87e-493a-ab55-0584eeb4e426'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:17.290460 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8e67f97e-19d4-406d-8cdb-b369d9c7b71a tempest-SnapshotsActionsTest-1968433713 None] Delete snapshot completed successfully. Mar 26 21:13:17.297324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8e67f97e-19d4-406d-8cdb-b369d9c7b71a tempest-SnapshotsActionsTest-1968433713 None] Lock "b'cinder-1cb05396-6090-4f70-ac58-742ca5567a35-delete_snapshot'" released by "delete_snapshot" :: held 0.598s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:17.726718 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Lock "b'cinder-0bd452d5-62f5-482e-a4df-d0aec36f3f73-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:17.807353 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:17.879785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:13:17.880265 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Volume volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:13:17.888624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] deleting rbd volume volume-0bd452d5-62f5-482e-a4df-d0aec36f3f73 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:13:17.946239 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a907bcc5-0c1b-4569-861d-32d5f05b1516 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:18.413499 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Created reservations ['d4ddbdec-2239-4307-ba91-23d65b698829', 'a53aee9e-77c3-40a0-943f-a751c1aa318c', 'b0a9bcb9-30bd-4388-bf86-be17b9844413', 'a192de54-1040-450f-b547-e258f4c859ad'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:18.510424 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:18.566938 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:18.651589 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:13:18.658490 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Deleted volume successfully. Mar 26 21:13:18.690149 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9d52fe01-07e5-4a23-a71f-517215640e39 tempest-SnapshotsActionsTest-1968433713 None] Lock "b'cinder-0bd452d5-62f5-482e-a4df-d0aec36f3f73-delete_volume'" released by "delete_volume" :: held 0.963s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:19.226559 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a907bcc5-0c1b-4569-861d-32d5f05b1516 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:13:20.108506 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eb6e311d-9d0c-43f5-847d-7cd712f58b6a tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-a6ddaddc-7c06-4060-a7a3-a7cde11775b7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:20.110642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eb6e311d-9d0c-43f5-847d-7cd712f58b6a tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:30.536948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:13:30.566434 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Flow 'volume_create_manager' (e506ea69-1c4b-4004-96a4-78c34b5d6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:13:30.576329 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5536279f-1223-4fe5-90cd-c50ebd7cca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:30.596535 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5536279f-1223-4fe5-90cd-c50ebd7cca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1320747016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ba647a6-466b-4511-9fa0-8d68327500c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6fb92c4f424aea8267c3a21b3d6cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:13:30Z,use_quota=True,user_id='d28f4446a2d34d50b6ad5d3ea85cba70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:30.603243 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4207051-3ca2-48f1-888d-7cae43e41ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:30.609022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4207051-3ca2-48f1-888d-7cae43e41ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:30.615413 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c21f1e3-1bbb-48cb-a0bc-16845189ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:30.744299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c21f1e3-1bbb-48cb-a0bc-16845189ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ba647a6-466b-4511-9fa0-8d68327500c3', 'volume_name': 'volume-0ba647a6-466b-4511-9fa0-8d68327500c3', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:30.750969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea804b76-538c-4511-9531-b65cfb14d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:30.756460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea804b76-538c-4511-9531-b65cfb14d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:30.767279 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecfa4ae-4a29-4c10-9078-22eb2aefe95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:30.770029 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Volume 0ba647a6-466b-4511-9fa0-8d68327500c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ba647a6-466b-4511-9fa0-8d68327500c3', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:13:30.770391 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Cloning 0ba647a6-466b-4511-9fa0-8d68327500c3 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:13:30.788381 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:30.803627 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 13, 30, 793597)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:13:30.804278 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:13:30.804764 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:13:30.813384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:30.814593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:13:30.821070 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 13, 30, 818704)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:13:30.821811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:13:30.822210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:13:30.843615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:30.928189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] creating snapshot='volume-0ba647a6-466b-4511-9fa0-8d68327500c3.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:13:31.918573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-0ba647a6-466b-4511-9fa0-8d68327500c3.clone_snap' to 'volume-0ba647a6-466b-4511-9fa0-8d68327500c3' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:13:31.965504 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d req-0e104f3b-93e0-45b7-91d5-52a1125296f8 tempest-AttachVolumeNegativeTest-571250188 None] Terminate volume connection completed successfully. Mar 26 21:13:31.965979 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d req-0e104f3b-93e0-45b7-91d5-52a1125296f8 tempest-AttachVolumeNegativeTest-571250188 None] Deleting attachment 5ace83d3-f230-4f66-bb87-b5a7803981f8. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:13:32.262058 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:13:32.268369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:13:32.269153 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:13:32.307967 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:13:32.310857 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Marking volume 0ba647a6-466b-4511-9fa0-8d68327500c3 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:13:32.326653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 0ba647a6-466b-4511-9fa0-8d68327500c3. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:13:32.328040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Creating volume glance metadata for volume 0ba647a6-466b-4511-9fa0-8d68327500c3 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:13:32.433803 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecfa4ae-4a29-4c10-9078-22eb2aefe95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba647a6-466b-4511-9fa0-8d68327500c3', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:32.439290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd9ec72-25b3-422a-be4e-19945d9c79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:32.461286 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Volume volume-0ba647a6-466b-4511-9fa0-8d68327500c3 (0ba647a6-466b-4511-9fa0-8d68327500c3): created successfully Mar 26 21:13:32.465461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd9ec72-25b3-422a-be4e-19945d9c79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:32.476052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Flow 'volume_create_manager' (e506ea69-1c4b-4004-96a4-78c34b5d6307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:13:32.491210 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-29a028b2-1c42-4a13-991c-25c56edecf4f tempest-VolumesImageMetadata-590110410 None] Created volume successfully. Mar 26 21:13:33.211823 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] Lock "b'cinder-0ba647a6-466b-4511-9fa0-8d68327500c3-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:33.331478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:33.464491 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:13:33.481783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] deleting rbd volume volume-0ba647a6-466b-4511-9fa0-8d68327500c3 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:13:33.840283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:13:33.892560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] deleting parent snapshot volume-0ba647a6-466b-4511-9fa0-8d68327500c3.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:13:35.009354 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] Created reservations ['0f4bc9b3-f9eb-45cc-85e3-a5e1af744c59', 'd12b9759-e5c0-45fa-918e-fb1d8cd56d93', '2bb5403b-aa58-450f-9519-4f98e4bdcc17', 'bcfdd7ac-5368-4a5a-9ca3-c1950ac73bd3'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:35.084267 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:35.138590 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:35.185811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:13:35.191395 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] Deleted volume successfully. Mar 26 21:13:35.209396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-86ca11a1-59d1-4f32-ab9e-8cf5287da32c tempest-VolumesImageMetadata-590110410 None] Lock "b'cinder-0ba647a6-466b-4511-9fa0-8d68327500c3-delete_volume'" released by "delete_volume" :: held 1.998s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:40.643572 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:13:40.715774 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Flow 'volume_create_manager' (bf2ae42f-828d-41b5-9821-733aa9c1a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:13:40.732976 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941d4441-0795-4085-b99f-7a1ae369884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:40.795088 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941d4441-0795-4085-b99f-7a1ae369884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-38869724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4fd57f54-2228-47c2-9176-f0bc602b8105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f1a08fcf2d470c85a370f1f111dcd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:13:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:13:41Z,use_quota=True,user_id='8ec9bbf6ebb34979a3a9115bdd829150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:40.801129 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db42437-4c12-4243-a33d-77ad9844b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:40.816261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db42437-4c12-4243-a33d-77ad9844b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:40.831319 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197eac18-5d10-47a2-85f1-31545b1b8d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:40.843106 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197eac18-5d10-47a2-85f1-31545b1b8d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd57f54-2228-47c2-9176-f0bc602b8105', 'volume_name': 'volume-4fd57f54-2228-47c2-9176-f0bc602b8105', 'volume_size': 2}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:40.857347 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a72491-17d0-4774-85bc-8d23320d73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:40.861933 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a72491-17d0-4774-85bc-8d23320d73d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:40.870632 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f67672-61f6-44e1-891f-f00c9edae08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:40.873359 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Volume 4fd57f54-2228-47c2-9176-f0bc602b8105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd57f54-2228-47c2-9176-f0bc602b8105', 'volume_size': 2} Mar 26 21:13:40.874242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] creating volume 'volume-4fd57f54-2228-47c2-9176-f0bc602b8105' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:13:40.875952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:41.046542 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:13:41.047185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:13:41.052069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f67672-61f6-44e1-891f-f00c9edae08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd57f54-2228-47c2-9176-f0bc602b8105', 'volume_size': 2}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:41.058104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68db5c73-6584-452d-a1e5-637d0566d4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:13:41.086390 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Volume volume-4fd57f54-2228-47c2-9176-f0bc602b8105 (4fd57f54-2228-47c2-9176-f0bc602b8105): created successfully Mar 26 21:13:41.096007 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68db5c73-6584-452d-a1e5-637d0566d4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:13:41.105897 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Flow 'volume_create_manager' (bf2ae42f-828d-41b5-9821-733aa9c1a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:13:41.137257 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-254fea18-5ef3-4e89-8d60-43c0c31cf5ae tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Created volume successfully. Mar 26 21:13:41.931399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-79445b7d-2c21-4c66-8e3d-ee1cbe457502 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:42.820788 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-79445b7d-2c21-4c66-8e3d-ee1cbe457502 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Create snapshot completed successfully Mar 26 21:13:43.097424 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fe75ca08-5078-4562-a68e-1f49659ed73d tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Lock "b'cinder-85748b00-b1a3-452b-aee4-7479a24f89dd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:43.105940 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fe75ca08-5078-4562-a68e-1f49659ed73d tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:43.839159 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-fe75ca08-5078-4562-a68e-1f49659ed73d tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Created reservations ['64c06473-bf8b-430e-b4eb-6be29ba81ad0', 'd65fbaf6-44f7-4a12-8fdb-bff323cd9b3e', '978bd1ed-da31-4ed2-8a53-83e2f30120dd', 'f9e391ac-fa6a-4bdf-9c86-5a7ac108d892'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:43.894145 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fe75ca08-5078-4562-a68e-1f49659ed73d tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Delete snapshot completed successfully. Mar 26 21:13:43.901105 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fe75ca08-5078-4562-a68e-1f49659ed73d tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Lock "b'cinder-85748b00-b1a3-452b-aee4-7479a24f89dd-delete_snapshot'" released by "delete_snapshot" :: held 0.804s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:44.341730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Lock "b'cinder-4fd57f54-2228-47c2-9176-f0bc602b8105-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:44.404884 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:44.468379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:13:44.468822 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Volume volume-4fd57f54-2228-47c2-9176-f0bc602b8105 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:13:44.482015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] deleting rbd volume volume-4fd57f54-2228-47c2-9176-f0bc602b8105 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:13:44.850474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Created reservations ['f273e78f-31d9-44bc-8e48-e3818f47054d', 'b31e8f15-56a8-45a5-a8f1-b6a12014e880', 'cb27c176-f05e-424e-9a02-3fad7205a879', '50199d30-6142-40d5-99b4-afa2825f906f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:44.930386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:45.024792 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:45.091750 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:13:45.107330 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Deleted volume successfully. Mar 26 21:13:45.127214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a7d463b5-00b5-4428-8248-69f144f98a23 tempest-VolumesSnapshotNegativeTestJSON-292586025 None] Lock "b'cinder-4fd57f54-2228-47c2-9176-f0bc602b8105-delete_volume'" released by "delete_volume" :: held 0.785s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:50.366212 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-eb6e311d-9d0c-43f5-847d-7cd712f58b6a tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['321c85ac-2fba-4043-8059-89e4f0a50783', '3b82f8af-90ea-4d7b-b837-19abad79aef6', '320252ad-91db-4618-a1a0-616d02e5ca8d', '8cc392ee-9330-407c-9b06-33f29a36037c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:13:50.405311 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-eb6e311d-9d0c-43f5-847d-7cd712f58b6a tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:13:50.411609 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eb6e311d-9d0c-43f5-847d-7cd712f58b6a tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-a6ddaddc-7c06-4060-a7a3-a7cde11775b7-delete_snapshot'" released by "delete_snapshot" :: held 30.304s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:13:50.813321 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-30243afa-c03e-4dda-a15e-d4ab517cbfe8 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-8992f4cb-284f-4b80-ac48-053e1da535c1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:13:50.815236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-30243afa-c03e-4dda-a15e-d4ab517cbfe8 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:58.291091 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:13:58.292335 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:58.355015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:13:58.426255 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:18.016751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8cb7822b-d28d-4efb-a1c3-c002cc7ad26c tempest-BackendsCapabilitiesAdminTestsJSON-85799057 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:46ba1a55-2d7f-4670-a7f0-529961f9b3b6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 26 21:14:18.054419 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9ab51e96-67c3-4c85-ae2a-cf475dd25ff0 tempest-BackendsCapabilitiesAdminTestsJSON-85799057 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:46ba1a55-2d7f-4670-a7f0-529961f9b3b6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}} Mar 26 21:14:21.047374 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-30243afa-c03e-4dda-a15e-d4ab517cbfe8 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['94c4998a-fa11-4377-a001-fa5cab1baa42', '11310f05-de6c-434a-81f1-2fc5ccfd9e99', '23f5cd63-0ca4-4ccb-9506-011d57ff7989', 'c0307aed-b714-4767-b575-259db0b68a52'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:21.132846 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-30243afa-c03e-4dda-a15e-d4ab517cbfe8 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:14:21.139294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-30243afa-c03e-4dda-a15e-d4ab517cbfe8 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-8992f4cb-284f-4b80-ac48-053e1da535c1-delete_snapshot'" released by "delete_snapshot" :: held 30.325s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:22.270299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-abfbb869-895d-4e57-a825-34bc911c9f54 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-e3c6e907-d70f-4732-982a-bd02648f1554-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:22.272183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-abfbb869-895d-4e57-a825-34bc911c9f54 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:25.474582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:14:25.535138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Flow 'volume_create_manager' (16b00edb-e856-48b4-a0a4-7e566a7653ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:25.543254 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac7eb10-5cdf-4c88-8559-d56ddca358bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.561277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac7eb10-5cdf-4c88-8559-d56ddca358bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-952469475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=826af7ed-cf0d-472c-bf8e-5d64fae89ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab496d26bdcf460eb2081b88189d7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:14:25Z,use_quota=True,user_id='4cb484292e0e4dc197dc9cb16fbe7baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.567345 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f68c100-84bf-4c77-986f-d13fe9cb009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.572813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f68c100-84bf-4c77-986f-d13fe9cb009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.578493 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f7c3b-5286-434a-8810-39d725d2b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.583790 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f7c3b-5286-434a-8810-39d725d2b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826af7ed-cf0d-472c-bf8e-5d64fae89ecf', 'volume_name': 'volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.589088 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d1ec8-6b5c-4dc4-b160-e40ea3b0f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.593604 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d1ec8-6b5c-4dc4-b160-e40ea3b0f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.600176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53573288-51da-4a6e-b5fb-219d272f53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.601716 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Volume 826af7ed-cf0d-472c-bf8e-5d64fae89ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf', 'volume_size': 1} Mar 26 21:14:25.602271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] creating volume 'volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:14:25.603243 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:25.702791 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:14:25.703503 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:14:25.708072 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53573288-51da-4a6e-b5fb-219d272f53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.714624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5afe3c-fc6d-4c65-af0a-f52b293c364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:25.734498 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Volume volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf (826af7ed-cf0d-472c-bf8e-5d64fae89ecf): created successfully Mar 26 21:14:25.741839 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5afe3c-fc6d-4c65-af0a-f52b293c364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:25.751018 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Flow 'volume_create_manager' (16b00edb-e856-48b4-a0a4-7e566a7653ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:25.765560 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-68d73259-f001-4771-82c8-7958b799d1fb tempest-VolumesDeleteCascade-1884703744 None] Created volume successfully. Mar 26 21:14:26.820112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0b88e011-5b87-4ba2-9b36-8d5890e21019 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:27.918733 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0b88e011-5b87-4ba2-9b36-8d5890e21019 tempest-VolumesDeleteCascade-1884703744 None] Create snapshot completed successfully Mar 26 21:14:29.202521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67241a10-4bea-4021-ab67-13b280bf9687 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:30.016412 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-67241a10-4bea-4021-ab67-13b280bf9687 tempest-VolumesDeleteCascade-1884703744 None] Create snapshot completed successfully Mar 26 21:14:30.357905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-826af7ed-cf0d-472c-bf8e-5d64fae89ecf-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:30.420444 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Performing cascade delete. {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}} Mar 26 21:14:30.471778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-b23591fb-9e94-4098-b1e0-8ffdda141712-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:30.515163 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:31.981883 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Created reservations ['2bb963d9-5a97-4824-a6a6-567eaf5affcd', 'f42fc419-dbc1-4b3f-b976-5022487a70d5', 'f8223a28-839b-498c-9e56-c6c10e1668af', 'dcc29c57-0a76-4db2-832a-c25d0a923adc'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:32.096259 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Delete snapshot completed successfully. Mar 26 21:14:32.106468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-b23591fb-9e94-4098-b1e0-8ffdda141712-delete_snapshot'" released by "delete_snapshot" :: held 1.640s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:32.124255 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-bb1ac4f5-030b-49cc-a9e1-171b282e1500-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:32.174698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:33.098419 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Created reservations ['660a5fa6-b091-4158-ad74-62920cc517b7', '3b240637-124d-4401-b30b-3914d26599bf', '96530a29-0333-4b42-819a-0c1b3e1a1b8b', 'de8592d5-db9a-4859-8f13-d22df9bb8517'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:33.154548 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-9efadd82-770b-44e8-9143-4a7feb97a697 tempest-TaggedBootDevicesTest_v242-272398941 None] Terminate volume connection completed successfully. Mar 26 21:14:33.155239 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-9efadd82-770b-44e8-9143-4a7feb97a697 tempest-TaggedBootDevicesTest_v242-272398941 None] Deleting attachment fcab46d4-4b34-49e0-ae59-6155f63cdeba. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:14:33.167034 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Delete snapshot completed successfully. Mar 26 21:14:33.174025 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-bb1ac4f5-030b-49cc-a9e1-171b282e1500-delete_snapshot'" released by "delete_snapshot" :: held 1.049s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:33.175297 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Snapshots deleted, issuing volume delete {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}} Mar 26 21:14:33.176381 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:33.262115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:33.263065 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Volume volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:14:33.275331 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] deleting rbd volume volume-826af7ed-cf0d-472c-bf8e-5d64fae89ecf {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:33.423548 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-0fc3d3f7-54e9-411d-b4c9-e2ee3d41717d tempest-TaggedBootDevicesTest_v242-272398941 None] Terminate volume connection completed successfully. Mar 26 21:14:33.423815 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-0fc3d3f7-54e9-411d-b4c9-e2ee3d41717d tempest-TaggedBootDevicesTest_v242-272398941 None] Deleting attachment 60467e92-dd9e-4458-8e90-5ef893bab697. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:14:33.621370 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-185f9ca6-7e89-4613-9bc6-9c6ade65d2b9 tempest-TaggedBootDevicesTest_v242-272398941 None] Terminate volume connection completed successfully. Mar 26 21:14:33.621791 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 req-185f9ca6-7e89-4613-9bc6-9c6ade65d2b9 tempest-TaggedBootDevicesTest_v242-272398941 None] Deleting attachment 9da94bc8-cfc3-4797-a744-67c6524c8836. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:14:33.924952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Created reservations ['96f68b03-1701-499a-9eb6-2a00d8d39f66', '6451cb65-67b8-442e-8cc7-0ba2df635b31', '752c2e73-0ab0-47d2-ac64-1e948ec13dd5', '2e134860-ae27-4f65-8065-7c5615f1101f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:34.061853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:34.155222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:34.241456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:34.249225 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Deleted volume successfully. Mar 26 21:14:34.264402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e15a040-5131-49ad-9959-8808b31bcf80 tempest-VolumesDeleteCascade-1884703744 None] Lock "b'cinder-826af7ed-cf0d-472c-bf8e-5d64fae89ecf-delete_volume'" released by "delete_volume" :: held 3.906s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:38.759749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:14:38.783897 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Flow 'volume_create_manager' (c1ff5f23-330b-4cc1-bd09-8b50d4a4ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:38.791620 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccce688-08f6-4518-ac7f-7bf55c5dd2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.799494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:14:38.823250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (2cd7d660-672d-4088-8997-8ad8ef7aaef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:38.843246 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9720b13-5832-4c4e-a054-d683f0ee9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.863538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccce688-08f6-4518-ac7f-7bf55c5dd2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1741619235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e64d2ca4-cd62-4d83-8520-59cb691ecbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec80ad7623e04c9180216b5bb1a38f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:14:39Z,use_quota=True,user_id='6aae7701ee964921bf4c26bb6c2a3793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.870427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac8a0c-5e32-4824-9bcf-5526bbd5c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.876228 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feac8a0c-5e32-4824-9bcf-5526bbd5c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.883558 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3205b-d94c-4239-b5fb-557cae9962ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.905943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9720b13-5832-4c4e-a054-d683f0ee9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1740957847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=08e254a2-447a-477c-aaaf-fc114ba77750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8e16658cc541b2976c9325d1558792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:14:39Z,use_quota=True,user_id='41ad4fbc224446efaf5ad85c8c87eeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.913010 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667441d7-80a8-4a61-9abc-e9fbdfc6546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.920798 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667441d7-80a8-4a61-9abc-e9fbdfc6546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.927386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e37799-85ee-4ee9-89d8-cfc120fad2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.932124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e37799-85ee-4ee9-89d8-cfc120fad2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e254a2-447a-477c-aaaf-fc114ba77750', 'volume_name': 'volume-08e254a2-447a-477c-aaaf-fc114ba77750', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.937631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66863da2-0b33-4fe3-b70d-f441c93f41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.942074 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66863da2-0b33-4fe3-b70d-f441c93f41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:38.947099 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6101314e-5890-45d3-ada9-016edef758b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:38.949636 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Volume 08e254a2-447a-477c-aaaf-fc114ba77750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e254a2-447a-477c-aaaf-fc114ba77750', 'volume_size': 1} Mar 26 21:14:38.950349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] creating volume 'volume-08e254a2-447a-477c-aaaf-fc114ba77750' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:14:38.951583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:39.107723 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:14:39.108277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:14:39.111830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6101314e-5890-45d3-ada9-016edef758b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e254a2-447a-477c-aaaf-fc114ba77750', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:39.123140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c23f14-1a76-4ec8-b874-8cd45eb160dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:39.148353 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3205b-d94c-4239-b5fb-557cae9962ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e64d2ca4-cd62-4d83-8520-59cb691ecbea', 'volume_name': 'volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:39.153990 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04864ae-fd40-46af-9b18-ee9af325a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:39.169683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04864ae-fd40-46af-9b18-ee9af325a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:39.174659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ee70d1-eb3f-4d52-b835-ca30ec5b79fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:39.176090 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Volume e64d2ca4-cd62-4d83-8520-59cb691ecbea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:14:39.176663 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Cloning e64d2ca4-cd62-4d83-8520-59cb691ecbea from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:14:39.190624 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-08e254a2-447a-477c-aaaf-fc114ba77750 (08e254a2-447a-477c-aaaf-fc114ba77750): created successfully Mar 26 21:14:39.195000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c23f14-1a76-4ec8-b874-8cd45eb160dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:39.203022 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (2cd7d660-672d-4088-8997-8ad8ef7aaef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:39.215196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.038s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:39.220705 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-eabf70ac-e980-4d3b-b927-d9a2dd2abccb tempest-AttachVolumeNegativeTest-571250188 None] Created volume successfully. Mar 26 21:14:39.244730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 14, 39, 219233)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:14:39.245528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:14:39.246186 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:14:39.261290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:39.266790 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:14:39.277932 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 14, 39, 273174)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:14:39.278726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:14:39.279356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:14:39.304353 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:39.396380 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] creating snapshot='volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:14:40.161516 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea.clone_snap' to 'volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:14:40.380014 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:14:40.381516 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:14:40.382087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:14:40.414129 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:14:40.414919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Marking volume e64d2ca4-cd62-4d83-8520-59cb691ecbea as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:14:40.438811 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-539c7c5c-07e2-4756-894e-c3767755e6bb req-8825ddb3-8d2c-47ef-891b-37b728cc6e7b tempest-AttachVolumeNegativeTest-571250188 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:14:40.471614 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to e64d2ca4-cd62-4d83-8520-59cb691ecbea. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:14:40.472158 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Creating volume glance metadata for volume e64d2ca4-cd62-4d83-8520-59cb691ecbea backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:14:40.587702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ee70d1-eb3f-4d52-b835-ca30ec5b79fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:40.592907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8d8bf6-cb98-4d9d-8cf5-cbed01adae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:40.615226 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Volume volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea (e64d2ca4-cd62-4d83-8520-59cb691ecbea): created successfully Mar 26 21:14:40.619596 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8d8bf6-cb98-4d9d-8cf5-cbed01adae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:40.626002 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Flow 'volume_create_manager' (c1ff5f23-330b-4cc1-bd09-8b50d4a4ffea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:40.651130 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0e2b3250-ff46-4535-823a-e0cb9b39ef8d tempest-VolumesExtendTest-963619698 None] Created volume successfully. Mar 26 21:14:41.015427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0167999-810a-4daa-a22c-c6e7845a81cb tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:41.247134 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b0167999-810a-4daa-a22c-c6e7845a81cb tempest-VolumesExtendTest-963619698 None] Extend volume from 1 GB to 2 GB. {{(pid=134842) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Mar 26 21:14:41.296545 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b0167999-810a-4daa-a22c-c6e7845a81cb tempest-VolumesExtendTest-963619698 None] Extend volume completed successfully. Mar 26 21:14:41.515358 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-539c7c5c-07e2-4756-894e-c3767755e6bb req-8825ddb3-8d2c-47ef-891b-37b728cc6e7b tempest-AttachVolumeNegativeTest-571250188 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.076s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:14:41.517653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-539c7c5c-07e2-4756-894e-c3767755e6bb req-8825ddb3-8d2c-47ef-891b-37b728cc6e7b tempest-AttachVolumeNegativeTest-571250188 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-08e254a2-447a-477c-aaaf-fc114ba77750', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '08e254a2-447a-477c-aaaf-fc114ba77750', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:14:41.540709 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-539c7c5c-07e2-4756-894e-c3767755e6bb req-8825ddb3-8d2c-47ef-891b-37b728cc6e7b tempest-AttachVolumeNegativeTest-571250188 None] Connection info returned from driver {'name': 'volumes/volume-08e254a2-447a-477c-aaaf-fc114ba77750', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '08e254a2-447a-477c-aaaf-fc114ba77750', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7ffddee0-7d10-48e3-a17f-72197023f314'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:14:41.611317 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-539c7c5c-07e2-4756-894e-c3767755e6bb req-8825ddb3-8d2c-47ef-891b-37b728cc6e7b tempest-AttachVolumeNegativeTest-571250188 None] attachment_update completed successfully. Mar 26 21:14:42.558801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:42.641674 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:42.752770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:42.753831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:14:42.763714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] deleting rbd volume volume-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:42.808962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:14:42.833548 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Flow 'volume_create_manager' (c42a91ca-84d6-47e6-b60f-1df5978a5756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:42.842102 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4310cc5-cc63-4dc1-b954-4d25b1fde53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:42.870617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4310cc5-cc63-4dc1-b954-4d25b1fde53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1682827438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=55ebf43a-7d1a-4550-91db-70b66251f175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec80ad7623e04c9180216b5bb1a38f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:14:43Z,use_quota=True,user_id='6aae7701ee964921bf4c26bb6c2a3793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:42.884591 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff2f47b-b6df-4311-acb2-07d435febf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:42.905980 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff2f47b-b6df-4311-acb2-07d435febf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:42.914358 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7752a5-fd2e-4e9c-848d-e2b4652bd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:42.921300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7752a5-fd2e-4e9c-848d-e2b4652bd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ebf43a-7d1a-4550-91db-70b66251f175', 'volume_name': 'volume-55ebf43a-7d1a-4550-91db-70b66251f175', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:42.927465 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d816a8-997c-43cc-af45-a48eb7d4f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:42.932382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d816a8-997c-43cc-af45-a48eb7d4f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:42.943946 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d2b0e4-224c-4152-a189-66de97c1ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:42.947186 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Volume 55ebf43a-7d1a-4550-91db-70b66251f175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ebf43a-7d1a-4550-91db-70b66251f175', 'volume_size': 1} Mar 26 21:14:42.947595 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] creating volume 'volume-55ebf43a-7d1a-4550-91db-70b66251f175' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:14:42.948321 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:43.050346 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:14:43.051277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:14:43.057830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d2b0e4-224c-4152-a189-66de97c1ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ebf43a-7d1a-4550-91db-70b66251f175', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:43.067498 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78597b80-c817-427b-b5eb-59b3be15aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:14:43.078875 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Volume volume-55ebf43a-7d1a-4550-91db-70b66251f175 (55ebf43a-7d1a-4550-91db-70b66251f175): created successfully Mar 26 21:14:43.084045 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78597b80-c817-427b-b5eb-59b3be15aa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:14:43.091319 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Flow 'volume_create_manager' (c42a91ca-84d6-47e6-b60f-1df5978a5756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:14:43.103658 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-27376c79-4035-4d34-a930-436f7d7e49d8 tempest-VolumesExtendTest-963619698 None] Created volume successfully. Mar 26 21:14:43.168001 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Created reservations ['0ab64006-25ab-4e36-860c-cfa4e2830acb', 'ebf0d6ec-39ae-4bfa-931f-618dd7fa201b', 'eb37a295-3ff1-464d-a7c8-96aee7f107df', 'a948d704-6fd4-406a-869d-39209549c190'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:43.239887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:43.303853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:43.356105 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:43.367420 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Deleted volume successfully. Mar 26 21:14:43.386660 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8ce042ec-d5f9-4dae-ac99-7b24514d76d2 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-6b44bb35-eb1c-47f9-a3cc-cf492d4eea16-delete_volume'" released by "delete_volume" :: held 0.828s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:43.773098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-df7e01bd-f149-463d-a824-e4f7814184a8-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:43.838415 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:43.933738 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:43.934468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Volume volume-df7e01bd-f149-463d-a824-e4f7814184a8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:14:43.949788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] deleting rbd volume volume-df7e01bd-f149-463d-a824-e4f7814184a8 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:44.313887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-44843d83-f5e3-4158-879b-1c24135f356c tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:44.523768 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Created reservations ['0da519ec-1403-493b-b177-23d10059ff48', 'ab51dc23-5742-46cf-9497-7f2b20fcc409', '0d848c7f-77a7-48ca-9a7c-350202ecefce', '7024a90c-f2c3-44d6-8c90-dab0d7cb4b82'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:44.614165 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:44.665504 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:44.700878 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:44.705910 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Deleted volume successfully. Mar 26 21:14:44.725945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a1921df2-5162-42c7-8a56-3e0f5177d7d3 tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-df7e01bd-f149-463d-a824-e4f7814184a8-delete_volume'" released by "delete_volume" :: held 0.953s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:45.018344 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:45.088647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:45.211698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:45.225338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] deleting rbd volume volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:45.245915 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-c066e9f9-b75f-49f1-85d7-e48d162c2601 req-882408d4-67e7-4f12-8ef9-b8903443559a tempest-AttachVolumeNegativeTest-571250188 None] Terminate volume connection completed successfully. Mar 26 21:14:45.246445 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-c066e9f9-b75f-49f1-85d7-e48d162c2601 req-882408d4-67e7-4f12-8ef9-b8903443559a tempest-AttachVolumeNegativeTest-571250188 None] Deleting attachment 7ffddee0-7d10-48e3-a17f-72197023f314. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:14:45.328540 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-44843d83-f5e3-4158-879b-1c24135f356c tempest-VolumesExtendTest-963619698 None] Create snapshot completed successfully Mar 26 21:14:45.654816 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:14:45.696942 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] deleting parent snapshot volume-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:14:46.851615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1da4819e-7a92-4711-963b-599273b9fbe2 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:46.970742 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] Created reservations ['0d29ee88-6ee3-4b04-8a27-cfa730314dca', '3fcdce1e-e748-4174-a69c-87621cda8c87', '3e95ea66-44bb-49c7-9cec-8d5dcc40a3e4', 'd934d5ce-2770-4cb3-b225-418c7324989a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:46.994201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1da4819e-7a92-4711-963b-599273b9fbe2 tempest-VolumesExtendTest-963619698 None] Extend volume from 1 GB to 2 GB. {{(pid=134842) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}} Mar 26 21:14:47.040755 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1da4819e-7a92-4711-963b-599273b9fbe2 tempest-VolumesExtendTest-963619698 None] Extend volume completed successfully. Mar 26 21:14:47.048858 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:47.079430 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:47.126831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:47.132702 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] Deleted volume successfully. Mar 26 21:14:47.146101 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9cd8d015-669d-4d53-9189-df57778b47ba tempest-TaggedBootDevicesTest_v242-272398941 None] Lock "b'cinder-a1e0e1a5-edb3-48a8-a377-46a9f8b4f398-delete_volume'" released by "delete_volume" :: held 2.128s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:47.869228 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-97376e84-0b26-4fed-93e9-e6aa8344b342 tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-66467316-0c9e-4fbd-bc75-fd042b537341-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:47.869228 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-97376e84-0b26-4fed-93e9-e6aa8344b342 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:48.991887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-97376e84-0b26-4fed-93e9-e6aa8344b342 tempest-VolumesExtendTest-963619698 None] Created reservations ['dab55fb0-602b-49ea-a753-e34c220d1682', '4156d279-d32f-442b-b274-7c1ebcf6ddd8', 'ad77a353-cbf9-4bc9-8a34-e7682a29dd6d', '25d3c08c-77bb-48d0-8306-936f001fdd03'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:49.085888 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-97376e84-0b26-4fed-93e9-e6aa8344b342 tempest-VolumesExtendTest-963619698 None] Delete snapshot completed successfully. Mar 26 21:14:49.093043 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-97376e84-0b26-4fed-93e9-e6aa8344b342 tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-66467316-0c9e-4fbd-bc75-fd042b537341-delete_snapshot'" released by "delete_snapshot" :: held 1.230s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:50.090440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-55ebf43a-7d1a-4550-91db-70b66251f175-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:50.158275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:50.262544 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:50.262969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Volume volume-55ebf43a-7d1a-4550-91db-70b66251f175 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:14:50.274665 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] deleting rbd volume volume-55ebf43a-7d1a-4550-91db-70b66251f175 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:50.750024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Created reservations ['a49952db-6d1e-47f6-9f51-f9b420d2479b', '8d153967-99a7-492c-a894-616d51d5f243', '1bdd92f2-fec0-4ef0-a403-e35f6cb49704', 'edcfe338-ea05-4f6e-bd3d-4dba1d148048'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:50.888895 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:50.955410 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:51.018099 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:51.027127 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Deleted volume successfully. Mar 26 21:14:51.051470 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5106de4c-05c6-4920-9186-447f4496acb5 tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-55ebf43a-7d1a-4550-91db-70b66251f175-delete_volume'" released by "delete_volume" :: held 0.961s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:51.289389 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-e64d2ca4-cd62-4d83-8520-59cb691ecbea-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:14:51.362613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:51.504621 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:14:51.530862 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] deleting rbd volume volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:14:51.932759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:14:51.985192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] deleting parent snapshot volume-e64d2ca4-cd62-4d83-8520-59cb691ecbea.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:14:53.057115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] Created reservations ['b16f4f77-cda9-4c3f-bd04-f6885bdb60a4', '5ebdab42-0237-4c79-acf3-71e8e86489ad', '4a8983c1-81b3-4024-9714-784b483f6e69', '09c450e9-8145-435f-a7e3-d094a3fe7d94'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:53.131969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-abfbb869-895d-4e57-a825-34bc911c9f54 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['3003c1f0-a30c-456e-bf13-3250bbd89eac', '6c7b85d6-0e6e-4202-be8f-7fb3a8da77e2', 'e7d08d94-2c42-4d41-bbe9-803ede571609', '2cf3a423-2a52-4c78-94b5-de70a5823455'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:14:53.224792 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:53.289377 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:53.357808 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:14:53.364342 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] Deleted volume successfully. Mar 26 21:14:53.395294 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1f684aa9-deaf-4b46-8b5c-9e04269364bc tempest-VolumesExtendTest-963619698 None] Lock "b'cinder-e64d2ca4-cd62-4d83-8520-59cb691ecbea-delete_volume'" released by "delete_volume" :: held 2.105s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:53.396026 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-abfbb869-895d-4e57-a825-34bc911c9f54 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:14:53.410702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-abfbb869-895d-4e57-a825-34bc911c9f54 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-e3c6e907-d70f-4732-982a-bd02648f1554-delete_snapshot'" released by "delete_snapshot" :: held 31.140s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:14:55.004485 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-64f5854e-37fa-4ea0-90de-d18bc69cc415 req-619a6bbb-d620-4831-84ea-16c7592043b2 tempest-VolumesSnapshotTestJSON-1730121226 None] Terminate volume connection completed successfully. Mar 26 21:14:55.005103 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-64f5854e-37fa-4ea0-90de-d18bc69cc415 req-619a6bbb-d620-4831-84ea-16c7592043b2 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleting attachment 520fe01a-891e-4e16-b6a1-121e9d8a760a. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:14:58.291529 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:14:58.292383 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:58.365675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:14:58.438423 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:00.884642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:00.928242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (3f61d1e3-1828-49c4-b044-4e4313030670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:00.948506 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79daf33-bc36-4a26-a640-b31511103669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:00.978544 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79daf33-bc36-4a26-a640-b31511103669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-979842180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5c28495-9c5e-4f29-8562-1b5880e1a591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:01Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:00.989526 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a8984-3054-4686-95d7-0e88f81619aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:00.995470 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a8984-3054-4686-95d7-0e88f81619aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:01.002994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a734110-a8fe-4f97-94df-8ebd32697a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:01.035764 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a734110-a8fe-4f97-94df-8ebd32697a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c28495-9c5e-4f29-8562-1b5880e1a591', 'volume_name': 'volume-f5c28495-9c5e-4f29-8562-1b5880e1a591', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:01.042660 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60314ac4-2f00-4211-927d-914d154739e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:01.047257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60314ac4-2f00-4211-927d-914d154739e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:01.053386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ead062f-1dc5-4126-bf74-b08fedad7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:01.055632 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume f5c28495-9c5e-4f29-8562-1b5880e1a591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c28495-9c5e-4f29-8562-1b5880e1a591', 'volume_size': 1} Mar 26 21:15:01.056297 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] creating volume 'volume-f5c28495-9c5e-4f29-8562-1b5880e1a591' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:15:01.057821 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:01.193911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:01.194705 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:01.200205 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ead062f-1dc5-4126-bf74-b08fedad7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c28495-9c5e-4f29-8562-1b5880e1a591', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:01.208730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d70f9-0f03-481e-b2bb-2c746d20ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:01.228331 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-f5c28495-9c5e-4f29-8562-1b5880e1a591 (f5c28495-9c5e-4f29-8562-1b5880e1a591): created successfully Mar 26 21:15:01.233037 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d70f9-0f03-481e-b2bb-2c746d20ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:01.243788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (3f61d1e3-1828-49c4-b044-4e4313030670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:01.259284 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-481ebba5-9fa7-4544-9ab8-39a881b41d76 tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:15:02.126080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9dfd5020-dd87-4594-9c2d-6b3044921790 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:03.017629 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9dfd5020-dd87-4594-9c2d-6b3044921790 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:15:03.905073 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:03.957367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (fe4d7397-62e4-433c-a7c6-0d0bcfbbd2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:03.966788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b100d14-f8c0-482c-8b65-3ffe1d11b144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:03.996655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b100d14-f8c0-482c-8b65-3ffe1d11b144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1501311830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ceeb415f-b0b6-43d4-8805-09a3af694cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d8548fe0-ff7d-4613-b3cc-6b526ba8ee7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:04Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.019420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110bfdf3-b051-4d41-a12d-d185b9ccd362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:04.027825 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110bfdf3-b051-4d41-a12d-d185b9ccd362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.034398 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1891160f-dafc-4f77-a5ab-0da2f1505998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:04.038892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1891160f-dafc-4f77-a5ab-0da2f1505998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ceeb415f-b0b6-43d4-8805-09a3af694cc4', 'volume_name': 'volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4', 'volume_size': 2, 'snapshot_id': 'd8548fe0-ff7d-4613-b3cc-6b526ba8ee7f'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.045416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc94d1d4-1783-46fa-bbba-dba601a8a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:04.050196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc94d1d4-1783-46fa-bbba-dba601a8a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.056136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f69f1e-1e71-4a9c-8260-ed1ffefa7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:04.057591 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Volume ceeb415f-b0b6-43d4-8805-09a3af694cc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4', 'volume_size': 2, 'snapshot_id': 'd8548fe0-ff7d-4613-b3cc-6b526ba8ee7f'} Mar 26 21:15:04.095794 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] cloning volumes/volume-f5c28495-9c5e-4f29-8562-1b5880e1a591@snapshot-d8548fe0-ff7d-4613-b3cc-6b526ba8ee7f to volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4 {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:15:04.097283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:04.154961 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:04.392659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:04.394080 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:04.400187 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:04.608247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f69f1e-1e71-4a9c-8260-ed1ffefa7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4', 'volume_size': 2, 'snapshot_id': 'd8548fe0-ff7d-4613-b3cc-6b526ba8ee7f'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.626467 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c3d6d9-942e-432a-8ba0-e7c5e5ddf4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:04.646417 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4 (ceeb415f-b0b6-43d4-8805-09a3af694cc4): created successfully Mar 26 21:15:04.650702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c3d6d9-942e-432a-8ba0-e7c5e5ddf4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:04.661237 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (fe4d7397-62e4-433c-a7c6-0d0bcfbbd2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:04.689008 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fa7ed5dd-a6d9-4528-a137-748fdf66238a tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:15:05.125421 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-ceeb415f-b0b6-43d4-8805-09a3af694cc4-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:05.206866 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:05.302767 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:05.316046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-ceeb415f-b0b6-43d4-8805-09a3af694cc4 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:05.731463 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['8725fefa-8cef-470a-95a8-e50263f25a2f', 'b9cc6435-8029-4a57-9e67-98d53614cdeb', 'e5a6dbbf-8b03-45bf-979c-f20faa72ade0', '740562c0-b0ce-4910-8af5-5b1fa2024b16'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:05.833404 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:05.945239 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:05.996865 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:06.003002 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:06.047462 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-52de612c-1fa9-4553-b1da-e7b64cd8b1e8 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-ceeb415f-b0b6-43d4-8805-09a3af694cc4-delete_volume'" released by "delete_volume" :: held 0.920s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:06.904046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:06.935780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (63ee5c6c-0ccc-41e2-95ea-d1df483a31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:06.943299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abcc2a8-ff41-4bef-be2b-fc2cd5f47a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:06.973720 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abcc2a8-ff41-4bef-be2b-fc2cd5f47a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1974715302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b82818e-f7de-4f10-9551-aa21b17f467a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:07Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:06.979988 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e823ebc-275a-4f0b-9127-40b3c2b32e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:06.984325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e823ebc-275a-4f0b-9127-40b3c2b32e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:06.990356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a0d44-5473-4504-b4e7-6f4a1f8d2d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:06.996081 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a0d44-5473-4504-b4e7-6f4a1f8d2d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b82818e-f7de-4f10-9551-aa21b17f467a', 'volume_name': 'volume-0b82818e-f7de-4f10-9551-aa21b17f467a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:07.001825 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d701776b-a84e-4df8-9c14-ede75f170ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:07.006347 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d701776b-a84e-4df8-9c14-ede75f170ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:07.011637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ae13a3-0a9e-463e-8a5f-f6eab676e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:07.013477 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume 0b82818e-f7de-4f10-9551-aa21b17f467a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b82818e-f7de-4f10-9551-aa21b17f467a', 'volume_size': 1} Mar 26 21:15:07.014060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] creating volume 'volume-0b82818e-f7de-4f10-9551-aa21b17f467a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:15:07.015018 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:07.131872 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:07.132518 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:07.147227 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ae13a3-0a9e-463e-8a5f-f6eab676e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b82818e-f7de-4f10-9551-aa21b17f467a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:07.154356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d49d3-efec-4832-932d-ea289fc72985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:07.182469 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-0b82818e-f7de-4f10-9551-aa21b17f467a (0b82818e-f7de-4f10-9551-aa21b17f467a): created successfully Mar 26 21:15:07.190909 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d49d3-efec-4832-932d-ea289fc72985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:07.198345 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (63ee5c6c-0ccc-41e2-95ea-d1df483a31f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:07.210818 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-313d01c4-f8e4-4a91-8238-3f5014616825 tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:15:08.363786 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5516d355-a511-4df1-9b0f-57f4bbf021c7 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:09.084192 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5516d355-a511-4df1-9b0f-57f4bbf021c7 tempest-VolumesSnapshotTestJSON-1730121226 None] Create snapshot completed successfully Mar 26 21:15:10.268551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:10.346368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (cfb3b231-facc-41ce-9baa-0de2a93a1b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:10.354739 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4e8a1b-3b70-4159-b321-176c749f8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.388512 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4e8a1b-3b70-4159-b321-176c749f8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-220078383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40f35d92-f45b-4c6a-812d-9490f0f9919f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4455ec1a2447ebb1f737c0d97fc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72181026-cd55-460e-ab62-a7a90cbfc0d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:10Z,use_quota=True,user_id='54a09bedd0ad4328b1e687fc5f7e3967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.400310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f61b08-1a73-4127-b792-28b446133ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.409678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f61b08-1a73-4127-b792-28b446133ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.420290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29759563-f13f-4da4-bb57-606554768c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.426179 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29759563-f13f-4da4-bb57-606554768c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40f35d92-f45b-4c6a-812d-9490f0f9919f', 'volume_name': 'volume-40f35d92-f45b-4c6a-812d-9490f0f9919f', 'volume_size': 1, 'snapshot_id': '72181026-cd55-460e-ab62-a7a90cbfc0d8'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.451325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd4c384-5a9c-4b1b-81d9-372ce387523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.456590 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd4c384-5a9c-4b1b-81d9-372ce387523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.461822 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a360bd-44e5-416d-ab20-ad3cf0feb598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.463198 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume 40f35d92-f45b-4c6a-812d-9490f0f9919f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40f35d92-f45b-4c6a-812d-9490f0f9919f', 'volume_size': 1, 'snapshot_id': '72181026-cd55-460e-ab62-a7a90cbfc0d8'} Mar 26 21:15:10.487155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] cloning volumes/volume-0b82818e-f7de-4f10-9551-aa21b17f467a@snapshot-72181026-cd55-460e-ab62-a7a90cbfc0d8 to volume-40f35d92-f45b-4c6a-812d-9490f0f9919f {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:15:10.488054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:10.568495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:10.774511 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:10.775263 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:10.804323 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a360bd-44e5-416d-ab20-ad3cf0feb598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f35d92-f45b-4c6a-812d-9490f0f9919f', 'volume_size': 1, 'snapshot_id': '72181026-cd55-460e-ab62-a7a90cbfc0d8'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.817097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a85c65-1c97-4a0f-977c-7aa3ab0e95c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:10.841629 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-40f35d92-f45b-4c6a-812d-9490f0f9919f (40f35d92-f45b-4c6a-812d-9490f0f9919f): created successfully Mar 26 21:15:10.845888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a85c65-1c97-4a0f-977c-7aa3ab0e95c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:10.857061 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Flow 'volume_create_manager' (cfb3b231-facc-41ce-9baa-0de2a93a1b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:10.888129 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8a07b4dd-1693-45dd-a69f-a5a1285f9761 tempest-VolumesSnapshotTestJSON-1730121226 None] Created volume successfully. Mar 26 21:15:11.354063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-40f35d92-f45b-4c6a-812d-9490f0f9919f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:11.494324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:11.616107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:11.629718 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-40f35d92-f45b-4c6a-812d-9490f0f9919f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:12.137918 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['2b14d8ca-339b-4f13-8247-f6fc7d7cdb11', '810b29d9-0e2f-4116-9570-88b137d2d58e', 'd39c50a0-e7d8-4b6c-a0bc-21db25fc78ce', 'c9573258-c7e2-4567-9bc9-4cb9934dd1c8'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:12.250369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:12.342831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:12.401258 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:12.409672 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:12.433136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c1a43541-b697-4a98-9cb2-f4b25c9e9e6b tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-40f35d92-f45b-4c6a-812d-9490f0f9919f-delete_volume'" released by "delete_volume" :: held 1.112s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:12.657097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-388a475d-b194-4847-95bf-b6e77f4e4ff2 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-72181026-cd55-460e-ab62-a7a90cbfc0d8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:12.663283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-388a475d-b194-4847-95bf-b6e77f4e4ff2 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:13.200403 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-388a475d-b194-4847-95bf-b6e77f4e4ff2 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['e46e3d42-d361-4d42-923f-84b3a9b16dd7', '294e3a75-0b74-4cd2-9ef5-91792ecebe3c', 'bb3679f6-be54-4f2b-b8ef-5cd6ba2fa301', '1dfc5218-1273-4f9f-b697-98f5744c5882'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:13.312023 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-388a475d-b194-4847-95bf-b6e77f4e4ff2 tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:15:13.319426 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-388a475d-b194-4847-95bf-b6e77f4e4ff2 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-72181026-cd55-460e-ab62-a7a90cbfc0d8-delete_snapshot'" released by "delete_snapshot" :: held 0.664s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:13.806579 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-0b82818e-f7de-4f10-9551-aa21b17f467a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:13.889722 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:13.996303 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:14.000574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-0b82818e-f7de-4f10-9551-aa21b17f467a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:15:14.017101 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-0b82818e-f7de-4f10-9551-aa21b17f467a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:14.590386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['006d52a1-5cd8-47c7-912b-4a4e006bee49', 'df7b1f8f-4e8c-42f4-a4ed-04982f708a5b', '551b4bc5-1f61-433d-8714-a7cf6916977c', '7ce05fc0-1045-4277-986b-132ad79be670'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:14.682396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:14.762801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:14.833358 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:14.837713 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:14.854272 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-87765ff0-e246-48dc-b696-2f815453e93c tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-0b82818e-f7de-4f10-9551-aa21b17f467a-delete_volume'" released by "delete_volume" :: held 1.048s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:15.127479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-80f46436-1dfe-424f-ad60-7d94b5c413dd tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-d8548fe0-ff7d-4613-b3cc-6b526ba8ee7f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:15.146642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-80f46436-1dfe-424f-ad60-7d94b5c413dd tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:16.270104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-80f46436-1dfe-424f-ad60-7d94b5c413dd tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['d5d4d37f-41c3-41a7-966e-c823420adc05', 'f85c0d6d-b9f3-474c-84ff-eb430b4da434', '487fc1b4-573b-4611-84a3-12b731c6f30c', '0ee3ad4e-d487-4a9c-9b7b-0b7a067057f9'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:16.348052 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-80f46436-1dfe-424f-ad60-7d94b5c413dd tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:15:16.355754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-80f46436-1dfe-424f-ad60-7d94b5c413dd tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-d8548fe0-ff7d-4613-b3cc-6b526ba8ee7f-delete_snapshot'" released by "delete_snapshot" :: held 1.228s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:17.434824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-f5c28495-9c5e-4f29-8562-1b5880e1a591-delete_volume'" acquired by "delete_volume" :: waited 0.043s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:17.523186 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:17.628681 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:17.629451 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-f5c28495-9c5e-4f29-8562-1b5880e1a591 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:15:17.645370 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-f5c28495-9c5e-4f29-8562-1b5880e1a591 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:18.082177 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['db369ae3-cbe0-4563-992d-b4139a7b7199', 'dfc572db-f28e-4a7d-b8fe-9d9a6aad04cd', '6061f5c3-9469-42ce-86cd-9e2df883f8f6', '431a23f5-431a-4396-88fe-2cc672e6372e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:18.172480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:18.241899 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:18.318340 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:18.341397 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:18.360032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9397aebe-c48e-4a02-bee2-59045f9a5e12 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-f5c28495-9c5e-4f29-8562-1b5880e1a591-delete_volume'" released by "delete_volume" :: held 0.926s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:18.802397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-c90bcbd0-9a75-48e6-a516-481e089658af-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:18.874137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:19.003869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:19.042166 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-c90bcbd0-9a75-48e6-a516-481e089658af {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:19.398260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:15:19.443621 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] deleting parent snapshot volume-c90bcbd0-9a75-48e6-a516-481e089658af.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:15:20.378677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['e7c35654-567a-49a6-995e-a088240446a9', '3e22baf6-fdcc-4169-af94-d883560daafc', 'e0e7ed9a-af9a-4955-af8d-494f1d0f0a70', '57bef429-5764-4a5c-b4a8-b8b6afc0f440'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:20.472831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:20.535283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:20.620000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:20.624367 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:20.652359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3fc36282-aff0-45cc-8dc4-b64efae9c337 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-c90bcbd0-9a75-48e6-a516-481e089658af-delete_volume'" released by "delete_volume" :: held 1.850s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:21.094878 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8a88c917-631e-4603-9661-f56978ec3c4b tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-25988537-311e-45e1-b94f-782168ebae7b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:21.097644 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8a88c917-631e-4603-9661-f56978ec3c4b tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:22.440736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8a88c917-631e-4603-9661-f56978ec3c4b tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['f0d1da0b-f707-4053-9fec-a624496ce71a', '6d88960c-b213-4f2c-905c-3cfaaf82de3c', '339965f6-1813-4a5d-9bb7-6349c7e8ce79', '6dc77bf5-a898-4798-b890-2c1b5204743e'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:22.520515 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8a88c917-631e-4603-9661-f56978ec3c4b tempest-VolumesSnapshotTestJSON-1730121226 None] Delete snapshot completed successfully. Mar 26 21:15:22.525500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8a88c917-631e-4603-9661-f56978ec3c4b tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-25988537-311e-45e1-b94f-782168ebae7b-delete_snapshot'" released by "delete_snapshot" :: held 1.431s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:23.414403 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-a1a81c96-3fa3-4167-be2b-3237aa8faf35-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:23.528271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:23.663863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:23.665698 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Volume volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:15:23.683331 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] deleting rbd volume volume-a1a81c96-3fa3-4167-be2b-3237aa8faf35 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:24.226873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Created reservations ['da064c7e-dc6d-48ad-9fa9-14441b72193d', 'b843bc36-4d7d-473e-82bf-0e9045588bfa', '9372c396-8fd0-46a6-a500-248414078934', '90641429-5d89-45fe-bf80-0687f6d7f90f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:24.318229 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:24.422054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:24.498102 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:24.504365 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Deleted volume successfully. Mar 26 21:15:24.525098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-416b872a-0f94-4c13-a833-79ed50868867 tempest-VolumesSnapshotTestJSON-1730121226 None] Lock "b'cinder-a1a81c96-3fa3-4167-be2b-3237aa8faf35-delete_volume'" released by "delete_volume" :: held 1.111s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:28.955785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:29.002073 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Flow 'volume_create_manager' (a68e83c2-7003-490f-b856-37c3389c7dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:29.009544 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40757721-a79c-4d6e-ba51-0551223df40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.027177 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40757721-a79c-4d6e-ba51-0551223df40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2146320314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=527b6607-db2c-4b3a-b985-2cbc8f04373e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1922967207fb4c17a20ee1aed55f8116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:29Z,use_quota=True,user_id='fa0e197e06274ad5811c8d50ed9c7570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.036100 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569347f3-f936-4786-b16b-a2ef559343f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.039480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569347f3-f936-4786-b16b-a2ef559343f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.046777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0033a6-f7fd-46bc-8f06-ec918efbbae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.051383 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0033a6-f7fd-46bc-8f06-ec918efbbae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527b6607-db2c-4b3a-b985-2cbc8f04373e', 'volume_name': 'volume-527b6607-db2c-4b3a-b985-2cbc8f04373e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.057665 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be66c84-0268-4fdd-b363-b72bcf3387e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.062244 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be66c84-0268-4fdd-b363-b72bcf3387e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.075433 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29139d79-c155-4055-bb16-be49fe4d91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.077441 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Volume 527b6607-db2c-4b3a-b985-2cbc8f04373e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527b6607-db2c-4b3a-b985-2cbc8f04373e', 'volume_size': 1} Mar 26 21:15:29.078102 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] creating volume 'volume-527b6607-db2c-4b3a-b985-2cbc8f04373e' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:15:29.080500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:29.220660 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:29.221301 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:29.226543 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29139d79-c155-4055-bb16-be49fe4d91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527b6607-db2c-4b3a-b985-2cbc8f04373e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.231618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95178f27-406d-4db2-a9c5-e520f120340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:29.258745 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Volume volume-527b6607-db2c-4b3a-b985-2cbc8f04373e (527b6607-db2c-4b3a-b985-2cbc8f04373e): created successfully Mar 26 21:15:29.262610 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95178f27-406d-4db2-a9c5-e520f120340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:29.271472 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Flow 'volume_create_manager' (a68e83c2-7003-490f-b856-37c3389c7dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:29.284353 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1db3817f-2c5e-4efd-a2d3-5fb6b9eeb4ab tempest-VolumesSnapshotListTestJSON-1059942749 None] Created volume successfully. Mar 26 21:15:30.147862 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1f86413e-5157-4163-a58a-1b31e242ec1f tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:30.966912 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1f86413e-5157-4163-a58a-1b31e242ec1f tempest-VolumesSnapshotListTestJSON-1059942749 None] Create snapshot completed successfully Mar 26 21:15:31.440734 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9567ff4e-e071-4295-8c5b-9772e46d8302 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:32.099101 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9567ff4e-e071-4295-8c5b-9772e46d8302 tempest-VolumesSnapshotListTestJSON-1059942749 None] Create snapshot completed successfully Mar 26 21:15:32.692015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f332b723-1537-4351-a27a-5d67d1ef727d tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:33.116144 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f332b723-1537-4351-a27a-5d67d1ef727d tempest-VolumesSnapshotListTestJSON-1059942749 None] Create snapshot completed successfully Mar 26 21:15:34.590594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8c1d855c-f93e-4767-9c89-2d195877a622 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-b4110e7b-b0da-406a-a7c6-c5bec9533e4a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:34.592092 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8c1d855c-f93e-4767-9c89-2d195877a622 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:35.146888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8c1d855c-f93e-4767-9c89-2d195877a622 tempest-VolumesSnapshotListTestJSON-1059942749 None] Created reservations ['be2edb78-69a9-4eb4-a9fb-4886338f86d9', 'a0038931-4f71-4189-851e-05e0268c3a47', '42f210d9-c577-4b93-a14f-b5743025b50a', '49d13141-af50-488f-aa4b-b7ca0b1d6bae'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:35.208164 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8c1d855c-f93e-4767-9c89-2d195877a622 tempest-VolumesSnapshotListTestJSON-1059942749 None] Delete snapshot completed successfully. Mar 26 21:15:35.212918 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8c1d855c-f93e-4767-9c89-2d195877a622 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-b4110e7b-b0da-406a-a7c6-c5bec9533e4a-delete_snapshot'" released by "delete_snapshot" :: held 0.622s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:35.741076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-261cc997-f5ac-4ff3-8bf6-63cc4aa99868 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-81b37e25-c6cb-412d-b387-480775012b96-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:35.742923 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-261cc997-f5ac-4ff3-8bf6-63cc4aa99868 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:37.055401 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-261cc997-f5ac-4ff3-8bf6-63cc4aa99868 tempest-VolumesSnapshotListTestJSON-1059942749 None] Created reservations ['04a112e0-316b-4c67-9230-a1a0d9b25637', '0dd0c89f-0c7c-4fce-b68f-0159a97d576b', '14f54e41-fe09-46a3-92ed-ba30a794c934', 'd5eb4eb8-9f4f-478a-b2b5-a8d691e75e65'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:37.129028 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-261cc997-f5ac-4ff3-8bf6-63cc4aa99868 tempest-VolumesSnapshotListTestJSON-1059942749 None] Delete snapshot completed successfully. Mar 26 21:15:37.133989 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-261cc997-f5ac-4ff3-8bf6-63cc4aa99868 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-81b37e25-c6cb-412d-b387-480775012b96-delete_snapshot'" released by "delete_snapshot" :: held 1.393s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:37.931234 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c7157e8d-c7ed-4340-bed2-b89dec848714 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-24bfa760-1b0e-4e11-ae0b-7bd5e6e905f9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:37.933291 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c7157e8d-c7ed-4340-bed2-b89dec848714 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:39.034261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c7157e8d-c7ed-4340-bed2-b89dec848714 tempest-VolumesSnapshotListTestJSON-1059942749 None] Created reservations ['39c2d1d5-9d07-480e-97e7-5b384455dd51', 'f2759b6a-1483-4829-9bc7-ac543b1c6f2e', 'b6e32334-95f2-4e27-bb99-0135e749868f', 'ab83a0d1-33ad-4418-92ee-245483ed399d'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:39.103165 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c7157e8d-c7ed-4340-bed2-b89dec848714 tempest-VolumesSnapshotListTestJSON-1059942749 None] Delete snapshot completed successfully. Mar 26 21:15:39.109610 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c7157e8d-c7ed-4340-bed2-b89dec848714 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-24bfa760-1b0e-4e11-ae0b-7bd5e6e905f9-delete_snapshot'" released by "delete_snapshot" :: held 1.178s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:40.123842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-527b6607-db2c-4b3a-b985-2cbc8f04373e-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:15:40.169245 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:40.215830 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:40.216251 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Volume volume-527b6607-db2c-4b3a-b985-2cbc8f04373e is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:15:40.223008 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] deleting rbd volume volume-527b6607-db2c-4b3a-b985-2cbc8f04373e {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:40.498474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Created reservations ['b56bfb04-2224-4f89-bd2a-30a55b81995f', '2dd89141-d4c9-4514-bb89-dc616977a427', '2602e1ed-b558-41d4-9cc0-fb34f97d8934', '4f6b92ff-09f8-4f55-909d-a14d1c8107c1'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:40.559262 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:40.620789 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:40.717839 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:40.723077 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Deleted volume successfully. Mar 26 21:15:40.741870 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-90e8b338-007a-44ad-addf-039402e88e39 tempest-VolumesSnapshotListTestJSON-1059942749 None] Lock "b'cinder-527b6607-db2c-4b3a-b985-2cbc8f04373e-delete_volume'" released by "delete_volume" :: held 0.618s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:15:51.749939 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-14c5551f-1926-40cf-87e8-3ef3a36431a3 tempest-GroupSnapshotsV319Test-631576112 None] Group tempest-GroupSnapshotsV319Test-Group-1579240338: creating Mar 26 21:15:51.768542 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-14c5551f-1926-40cf-87e8-3ef3a36431a3 tempest-GroupSnapshotsV319Test-631576112 None] Group tempest-GroupSnapshotsV319Test-Group-1579240338: created successfully Mar 26 21:15:51.776888 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-14c5551f-1926-40cf-87e8-3ef3a36431a3 tempest-GroupSnapshotsV319Test-631576112 None] Create group completed successfully. Mar 26 21:15:53.150949 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:53.170284 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Flow 'volume_create_manager' (e7494df5-d550-463a-b9bc-0ef8c2c8a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:53.176944 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeaba83-b6f3-46ad-933b-b5af2d07688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.193160 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeaba83-b6f3-46ad-933b-b5af2d07688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1844368306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eb9ac92-30a4-429d-b9be-4bc7459e8da1,host='ncdv-master-1@ceph#ceph',id=9743efba-cad9-4256-aa71-2b8c8c0933f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805dc18820054dca83228dc85ce8101b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:53Z,use_quota=True,user_id='abfa602e90e24ed599dd3afc4dcfac55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bf0820a-e8fe-44ad-8c89-a8823afde2b1),volume_type_id=5bf0820a-e8fe-44ad-8c89-a8823afde2b1)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.198688 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bbd04b-8b3a-4329-b9a8-b3b8a72278ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.203129 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bbd04b-8b3a-4329-b9a8-b3b8a72278ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.208930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6becda9b-7fb7-4e43-9ae5-928bd57ef63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.213174 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6becda9b-7fb7-4e43-9ae5-928bd57ef63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9743efba-cad9-4256-aa71-2b8c8c0933f9', 'volume_name': 'volume-9743efba-cad9-4256-aa71-2b8c8c0933f9', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.218109 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf13ccd-603e-49ff-864d-cbbbd17e0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.222134 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf13ccd-603e-49ff-864d-cbbbd17e0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.226961 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424f85a8-8aa0-4034-b2e3-cdf64697c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.228139 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Volume 9743efba-cad9-4256-aa71-2b8c8c0933f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9743efba-cad9-4256-aa71-2b8c8c0933f9', 'volume_size': 1} Mar 26 21:15:53.228537 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] creating volume 'volume-9743efba-cad9-4256-aa71-2b8c8c0933f9' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:15:53.229322 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:53.282055 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:53.282542 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:53.286626 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424f85a8-8aa0-4034-b2e3-cdf64697c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9743efba-cad9-4256-aa71-2b8c8c0933f9', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.291405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c82b312-7d88-4f38-818b-a43d5014c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:53.301342 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Volume volume-9743efba-cad9-4256-aa71-2b8c8c0933f9 (9743efba-cad9-4256-aa71-2b8c8c0933f9): created successfully Mar 26 21:15:53.305214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c82b312-7d88-4f38-818b-a43d5014c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:53.310912 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Flow 'volume_create_manager' (e7494df5-d550-463a-b9bc-0ef8c2c8a125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:53.319357 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ca417fc2-6c36-4d58-8e48-81c085416933 tempest-GroupSnapshotsV319Test-631576112 None] Created volume successfully. Mar 26 21:15:54.384792 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d81cfbeb-5f6d-422c-b6c8-6d10c657cbaf tempest-GroupSnapshotsV319Test-631576112 None] GroupSnapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: creating. Mar 26 21:15:54.414653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d81cfbeb-5f6d-422c-b6c8-6d10c657cbaf tempest-GroupSnapshotsV319Test-631576112 None] Group snapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: creating. {{(pid=134842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 26 21:15:54.427696 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d81cfbeb-5f6d-422c-b6c8-6d10c657cbaf tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:54.675898 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:15:54.695411 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (ca95dfe1-4b0e-4ff2-af51-28b03d2fb967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:54.702572 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535d67fd-8422-46e5-a051-18a43d1c51f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.718437 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535d67fd-8422-46e5-a051-18a43d1c51f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-348905881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b07df397-0d4f-4fff-8cad-eb943ad38c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8e16658cc541b2976c9325d1558792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:15:55Z,use_quota=True,user_id='41ad4fbc224446efaf5ad85c8c87eeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.724306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5d1d3b-cdb5-41d6-84c2-74d175beed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.728678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5d1d3b-cdb5-41d6-84c2-74d175beed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.734161 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbff8494-c786-4a56-b8c9-822921af8309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.738638 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbff8494-c786-4a56-b8c9-822921af8309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'volume_name': 'volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.743937 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a920b367-903e-47cc-876e-91b3beac2760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.747941 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a920b367-903e-47cc-876e-91b3beac2760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.753230 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92294369-731d-4961-be95-1157cb027682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.754317 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Volume b07df397-0d4f-4fff-8cad-eb943ad38c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'volume_size': 1} Mar 26 21:15:54.754709 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] creating volume 'volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:15:54.755364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:54.804535 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:15:54.805012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:15:54.809051 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92294369-731d-4961-be95-1157cb027682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.814741 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0105e8-3f56-4f2c-acd2-5b516c99c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:15:54.823694 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e (b07df397-0d4f-4fff-8cad-eb943ad38c9e): created successfully Mar 26 21:15:54.827537 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0105e8-3f56-4f2c-acd2-5b516c99c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:15:54.833207 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Flow 'volume_create_manager' (ca95dfe1-4b0e-4ff2-af51-28b03d2fb967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:15:54.841008 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4f0921d6-e041-4347-b5c7-1f72f3090f1a tempest-AttachVolumeNegativeTest-571250188 None] Created volume successfully. Mar 26 21:15:55.132537 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d81cfbeb-5f6d-422c-b6c8-6d10c657cbaf tempest-GroupSnapshotsV319Test-631576112 None] group_snapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: created successfully Mar 26 21:15:55.801486 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] group_snapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: deleting Mar 26 21:15:55.817650 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] group_snapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: deleting {{(pid=134842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 26 21:15:55.844870 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:56.170891 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 req-6acc5dbf-7e68-4136-bef9-aaaaedfe16a4 tempest-AttachVolumeNegativeTest-571250188 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:15:56.806964 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 req-6acc5dbf-7e68-4136-bef9-aaaaedfe16a4 tempest-AttachVolumeNegativeTest-571250188 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:15:56.808551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 req-6acc5dbf-7e68-4136-bef9-aaaaedfe16a4 tempest-AttachVolumeNegativeTest-571250188 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:15:56.831309 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 req-6acc5dbf-7e68-4136-bef9-aaaaedfe16a4 tempest-AttachVolumeNegativeTest-571250188 None] Connection info returned from driver {'name': 'volumes/volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b07df397-0d4f-4fff-8cad-eb943ad38c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'daae0f79-3714-481b-8d71-07650259f248'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:15:56.881193 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 req-6acc5dbf-7e68-4136-bef9-aaaaedfe16a4 tempest-AttachVolumeNegativeTest-571250188 None] attachment_update completed successfully. Mar 26 21:15:56.964226 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1484003983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1484003983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:15:56.964973 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1484003983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1484003983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:15:56.979336 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] Created reservations ['59124911-2f1e-4bbd-9f67-ff214c47b87d', '2e12553f-256e-4b27-adfb-8d538d84d31c', '98723a40-7bb0-4b3c-b1dc-8dc11163dc48', 'f780305b-fdc2-4000-b9eb-834c8731eb90'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:57.029056 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b5b1b31e-6447-41a7-993f-cda67c0bcf70 tempest-GroupSnapshotsV319Test-631576112 None] group_snapshot 518a36af-043d-493f-9802-33bd2fc9fd3d: deleted successfully Mar 26 21:15:57.241001 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:57.293180 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:15:57.293751 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Volume volume-9743efba-cad9-4256-aa71-2b8c8c0933f9 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:15:57.300517 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] deleting rbd volume volume-9743efba-cad9-4256-aa71-2b8c8c0933f9 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:15:57.528700 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Created reservations ['ca2a0caf-64a4-440e-9834-5ebd7763e974'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:57.546727 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1484003983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1484003983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:15:57.561031 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Created reservations ['fbbfaf3e-3966-48ea-a3c1-8f806dca84d7', '06b69793-472b-4407-b881-5fec75e85197', 'a5c42428-d77b-44b7-86d7-efd082268a89', '3065cabf-d24c-461e-a9ed-ee5ded768e81'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:15:57.635624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:57.661124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:57.688926 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:15:57.694049 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-e37aeaf4-ebba-4da9-ab07-03678dd6d09e tempest-GroupSnapshotsV319Test-631576112 None] Delete group completed successfully. Mar 26 21:15:58.294124 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:15:58.295478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:58.328317 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:15:58.365163 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:00.347625 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-600fa764-9053-44bf-9b73-f91de2bfaa14 req-ff4d1fba-4797-4d49-8244-4f4002b2d7d8 tempest-AttachVolumeNegativeTest-571250188 None] Terminate volume connection completed successfully. Mar 26 21:16:00.348782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-600fa764-9053-44bf-9b73-f91de2bfaa14 req-ff4d1fba-4797-4d49-8244-4f4002b2d7d8 tempest-AttachVolumeNegativeTest-571250188 None] Deleting attachment daae0f79-3714-481b-8d71-07650259f248. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:16:05.833253 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-b07df397-0d4f-4fff-8cad-eb943ad38c9e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:05.870615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:05.929499 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:05.929936 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:05.942412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] deleting rbd volume volume-b07df397-0d4f-4fff-8cad-eb943ad38c9e {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:06.213621 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Created reservations ['84620b47-06ea-4830-9771-25d6d63cbd0b', 'ec1215c1-a1d1-4976-b0e5-a5f3b4a8b3cb', '9c453b26-6053-4d4c-950c-acb14be92abd', 'f58807e8-d831-4f59-87ee-be01494c5b99'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:06.277459 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:06.310341 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:06.350107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:06.358052 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Deleted volume successfully. Mar 26 21:16:06.371495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-da87373d-1968-44be-b6ba-b41c39fdf990 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-b07df397-0d4f-4fff-8cad-eb943ad38c9e-delete_volume'" released by "delete_volume" :: held 0.538s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:06.751816 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:06.773134 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Flow 'volume_create_manager' (04f92b19-6276-4ee9-b3f4-5adf8065fd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:06.779845 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fe7ad8-eb5c-4f7e-b759-78e72334f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.795267 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fe7ad8-eb5c-4f7e-b759-78e72334f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-175233647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=52a75f46-2c3f-48ac-bac9-591b138f8137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8690b216640459c93f31e499a14b364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:07Z,use_quota=True,user_id='00eed1658e37429c9aa2ac02e3e49c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88dae48d-3f1d-4232-ae4a-8fd9ae061246),volume_type_id=88dae48d-3f1d-4232-ae4a-8fd9ae061246)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.800900 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c5bcb4-2491-4795-8ac0-731cb54fe06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.805478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c5bcb4-2491-4795-8ac0-731cb54fe06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.810714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3d253a-d2db-45f6-a25d-72f10cd5ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.814929 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3d253a-d2db-45f6-a25d-72f10cd5ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a75f46-2c3f-48ac-bac9-591b138f8137', 'volume_name': 'volume-52a75f46-2c3f-48ac-bac9-591b138f8137', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.820001 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd04a040-1dd6-41da-a09e-2e2674a6e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.824106 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd04a040-1dd6-41da-a09e-2e2674a6e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.829357 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecc19a9-6420-465d-ad54-69ff0fe3165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.830537 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Volume 52a75f46-2c3f-48ac-bac9-591b138f8137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a75f46-2c3f-48ac-bac9-591b138f8137', 'volume_size': 1} Mar 26 21:16:06.830907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] creating volume 'volume-52a75f46-2c3f-48ac-bac9-591b138f8137' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:06.831834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:06.882497 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:06.883177 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:06.886806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecc19a9-6420-465d-ad54-69ff0fe3165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a75f46-2c3f-48ac-bac9-591b138f8137', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.892026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f43bc5-a535-428b-bb4d-ae3bbe3d57dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:06.901266 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Volume volume-52a75f46-2c3f-48ac-bac9-591b138f8137 (52a75f46-2c3f-48ac-bac9-591b138f8137): created successfully Mar 26 21:16:06.905043 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f43bc5-a535-428b-bb4d-ae3bbe3d57dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:06.911344 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Flow 'volume_create_manager' (04f92b19-6276-4ee9-b3f4-5adf8065fd87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:06.924477 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6c76cbbb-18fb-4d95-8fd3-6f0b16029765 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Created volume successfully. Mar 26 21:16:07.061578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-08e254a2-447a-477c-aaaf-fc114ba77750-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:07.092759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:07.138516 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:07.139027 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-08e254a2-447a-477c-aaaf-fc114ba77750 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:07.145101 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] deleting rbd volume volume-08e254a2-447a-477c-aaaf-fc114ba77750 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:07.356438 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Created reservations ['b578bfa9-db96-49e9-ad15-cca3efe5915c', 'd1320082-18eb-4b9f-b672-25729c7af8ee', '675b9461-d46a-43d1-be02-b12266785831', '5eb23369-0aca-43e8-aa90-a7a6b4509faa'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:07.404612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:07.426916 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:07.453348 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:07.457540 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Deleted volume successfully. Mar 26 21:16:07.472826 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-78980cd7-7872-498b-ae98-00dd19d594c2 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-08e254a2-447a-477c-aaaf-fc114ba77750-delete_volume'" released by "delete_volume" :: held 0.411s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:08.137079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d11aa8a9-bd37-4e89-83de-aa71c6805944 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:08.183277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d11aa8a9-bd37-4e89-83de-aa71c6805944 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:08.214202 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-d11aa8a9-bd37-4e89-83de-aa71c6805944 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:08.219008 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d11aa8a9-bd37-4e89-83de-aa71c6805944 tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Retype volume completed successfully. Mar 26 21:16:08.339704 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-e32deedb-a38c-4fdd-85c2-a35f8d222c58-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:08.374083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:08.414994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:08.415427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Volume volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:08.420478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] deleting rbd volume volume-e32deedb-a38c-4fdd-85c2-a35f8d222c58 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:08.654451 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Created reservations ['6350be20-3345-49db-b996-21cd331cd1e7', 'a03605b4-f808-434c-ac85-645a26a65e33', '0c909ecb-0f16-4779-989d-1cb52e98415a', 'aef8d462-1e02-4068-aecf-dde31a263167'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:08.677871 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-033a6f2d-7549-440c-8316-0a1bcf980297 tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-303634000: creating Mar 26 21:16:08.702360 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-033a6f2d-7549-440c-8316-0a1bcf980297 tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-303634000: created successfully Mar 26 21:16:08.713423 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-033a6f2d-7549-440c-8316-0a1bcf980297 tempest-GroupSnapshotsTest-989701389 None] Create group completed successfully. Mar 26 21:16:08.720885 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:08.742345 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:08.764586 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:08.769149 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Deleted volume successfully. Mar 26 21:16:08.780343 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-2120b822-3a96-4e92-9d24-53bc2f712979 tempest-AttachVolumeNegativeTest-571250188 None] Lock "b'cinder-e32deedb-a38c-4fdd-85c2-a35f8d222c58-delete_volume'" released by "delete_volume" :: held 0.441s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:09.269788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Lock "b'cinder-52a75f46-2c3f-48ac-bac9-591b138f8137-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:09.300167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:09.337183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:09.337580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Volume volume-52a75f46-2c3f-48ac-bac9-591b138f8137 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:09.343363 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] deleting rbd volume volume-52a75f46-2c3f-48ac-bac9-591b138f8137 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:09.534393 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:09.535094 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:09.548964 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Created reservations ['ce63be8b-5d2e-4589-a406-48c2a9469e35', '1bd17fda-51bf-43b3-b16e-5336e3eded89', '51cdbec5-d4c8-410b-a054-1e6fd9cd40c5', 'f9321959-5300-46b0-9dae-73c8d92e7d73'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:09.589240 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:09.612938 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:09.643455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:09.648469 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Deleted volume successfully. Mar 26 21:16:09.661603 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-69fda456-482d-4cfc-b91c-c737c410864d tempest-VolumeRetypeWithoutMigrationTest-1716172757 None] Lock "b'cinder-52a75f46-2c3f-48ac-bac9-591b138f8137-delete_volume'" released by "delete_volume" :: held 0.392s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:10.073178 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:10.093649 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (788d6210-84ad-4c66-b2a2-3b5442c0cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:10.100273 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450bd1b3-8495-495e-80cd-70acc26b14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.115214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450bd1b3-8495-495e-80cd-70acc26b14a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1923108087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c159804d-1102-43b0-aaba-779e0b866ca6,host='ncdv-master-1@ceph#ceph',id=6ccfe2d4-4279-42c5-91f5-9ce2031d90c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119e0afe758a4e3c8aff0fe6f709cb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:10Z,use_quota=True,user_id='bf334063c524416f943d5a30581912cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4964ea96-062f-4f23-b34c-a16ce2e73524),volume_type_id=4964ea96-062f-4f23-b34c-a16ce2e73524)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.120601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ace0cf-2b9f-468f-ac10-daf874df8b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.125724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ace0cf-2b9f-468f-ac10-daf874df8b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.130594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c644181f-0d23-4d07-a557-ae0444a99b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.134706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c644181f-0d23-4d07-a557-ae0444a99b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccfe2d4-4279-42c5-91f5-9ce2031d90c5', 'volume_name': 'volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.139667 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d428b0-250f-4cfb-94f3-c60d1317afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.144301 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d428b0-250f-4cfb-94f3-c60d1317afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.149075 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55aa62f-1d0b-4078-acac-e46a99ea3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.150302 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Volume 6ccfe2d4-4279-42c5-91f5-9ce2031d90c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5', 'volume_size': 1} Mar 26 21:16:10.150710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] creating volume 'volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:10.151469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:10.212409 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:10.212777 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:10.216577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55aa62f-1d0b-4078-acac-e46a99ea3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.221335 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f88623-1a9b-4307-aaf3-ffc21554f532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:10.230873 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Volume volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5 (6ccfe2d4-4279-42c5-91f5-9ce2031d90c5): created successfully Mar 26 21:16:10.234568 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f88623-1a9b-4307-aaf3-ffc21554f532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:10.240213 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (788d6210-84ad-4c66-b2a2-3b5442c0cd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:10.249164 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-30ceed37-ed13-4668-8ffd-a36a1421b54a tempest-GroupSnapshotsTest-989701389 None] Created volume successfully. Mar 26 21:16:11.358612 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6d2de868-25ef-4adc-9ed7-a9ef970e92a9 tempest-GroupSnapshotsTest-989701389 None] GroupSnapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: creating. Mar 26 21:16:11.419278 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6d2de868-25ef-4adc-9ed7-a9ef970e92a9 tempest-GroupSnapshotsTest-989701389 None] Group snapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: creating. {{(pid=134842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 26 21:16:11.440673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6d2de868-25ef-4adc-9ed7-a9ef970e92a9 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:12.104796 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6d2de868-25ef-4adc-9ed7-a9ef970e92a9 tempest-GroupSnapshotsTest-989701389 None] group_snapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: created successfully Mar 26 21:16:13.097446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] cloning volumes/volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5@snapshot-27b2359b-34e1-45ef-85ad-de9bda06499d to volume-8bfca427-0ffd-4c3b-a228-491071eab769 {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:16:13.102217 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:13.197607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:13.411492 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:13.411898 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:13.478313 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-663f5943-dad7-4a61-8621-7751637fa9bb tempest-GroupSnapshotsTest-989701389 None] Create group from source-snapshot-ad7711f1-b4b9-472e-865d-9ec3eb81b2ab completed successfully. Mar 26 21:16:14.024617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:14.047083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (2f7a6404-54d7-449f-81f3-e96dc7a5528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:14.054797 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64c289c-504d-4a9d-9b92-df75ec665798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:14.069735 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64c289c-504d-4a9d-9b92-df75ec665798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1988395231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06f2355f-dc98-4c01-a5f9-e2c295376722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e98880faf84d28ad553bf14cd07acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:14Z,use_quota=True,user_id='c9c36d1ec4c1447da3add85c97535a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:14.075250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b9dba3-29da-4113-9523-11117be7563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:14.079515 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b9dba3-29da-4113-9523-11117be7563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:14.084728 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33ea41-15dd-4873-a72b-e5bfac179fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:14.173144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d33ea41-15dd-4873-a72b-e5bfac179fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06f2355f-dc98-4c01-a5f9-e2c295376722', 'volume_name': 'volume-06f2355f-dc98-4c01-a5f9-e2c295376722', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:14.178637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d265e-42e4-42fc-a8c6-7212d8268282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:14.183097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d265e-42e4-42fc-a8c6-7212d8268282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:14.189048 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ee81bb-2998-4867-99a1-a8a731524b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:14.189396 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Volume 06f2355f-dc98-4c01-a5f9-e2c295376722: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06f2355f-dc98-4c01-a5f9-e2c295376722', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:16:14.189974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Cloning 06f2355f-dc98-4c01-a5f9-e2c295376722 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:16:14.198052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:14.207131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 16, 14, 202170)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:16:14.207863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:16:14.208355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:16:14.213052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:14.214100 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:16:14.220226 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 16, 14, 217543)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:16:14.220648 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:16:14.221039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:16:14.231668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:14.291075 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] creating snapshot='volume-06f2355f-dc98-4c01-a5f9-e2c295376722.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:16:15.057568 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-06f2355f-dc98-4c01-a5f9-e2c295376722.clone_snap' to 'volume-06f2355f-dc98-4c01-a5f9-e2c295376722' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:16:15.087617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:15.160531 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:15.170249 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] deleting rbd volume volume-8bfca427-0ffd-4c3b-a228-491071eab769 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:15.232640 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:15.235176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:15.235568 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:15.259044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:16:15.259651 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Marking volume 06f2355f-dc98-4c01-a5f9-e2c295376722 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:16:15.268859 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 06f2355f-dc98-4c01-a5f9-e2c295376722. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:16:15.269262 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Creating volume glance metadata for volume 06f2355f-dc98-4c01-a5f9-e2c295376722 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:16:15.328165 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ee81bb-2998-4867-99a1-a8a731524b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f2355f-dc98-4c01-a5f9-e2c295376722', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:15.332927 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d208423-fddd-4d34-867c-d42df6f333fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:15.341674 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Volume volume-06f2355f-dc98-4c01-a5f9-e2c295376722 (06f2355f-dc98-4c01-a5f9-e2c295376722): created successfully Mar 26 21:16:15.346921 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d208423-fddd-4d34-867c-d42df6f333fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:15.354236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (2f7a6404-54d7-449f-81f3-e96dc7a5528c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:15.363520 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-59c4692d-dedb-47bc-993b-4cc29507c7a5 tempest-VolumesCloneTest-1782489189 None] Created volume successfully. Mar 26 21:16:15.429181 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Created reservations ['8692cfd6-ab89-49c6-9545-5168d4125d10'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:15.446992 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-745303625 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-745303625, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:15.447782 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-745303625 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-745303625, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:15.460971 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Created reservations ['9fee980d-ea80-4bba-861e-651badb594fc', 'ec93ff6c-f607-41c0-a91c-405a0402f7db', 'a66a6cba-b0b7-4557-baa5-d77806f8e227', '05adb031-153a-4296-92b3-d5bfa9ad3586'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:15.537924 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:15.568320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:15.598261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:15.601993 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ab9367ea-0ef1-4b0e-a548-d557425f5bba tempest-GroupSnapshotsTest-989701389 None] Delete group completed successfully. Mar 26 21:16:15.846325 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] group_snapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: deleting Mar 26 21:16:15.861309 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] group_snapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: deleting {{(pid=134842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 26 21:16:15.877502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:16.408618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:16.439010 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (ab3cf016-7e29-4c98-babc-c36a8bc281fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:16.446112 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549cc2fb-88cc-4200-82bc-80d0e81be78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:16.462917 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549cc2fb-88cc-4200-82bc-80d0e81be78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-178300066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28318cc5-ff77-436b-ba10-3ffb2383ad76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e98880faf84d28ad553bf14cd07acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=06f2355f-dc98-4c01-a5f9-e2c295376722,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:16Z,use_quota=True,user_id='c9c36d1ec4c1447da3add85c97535a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:16.468624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56e70b3-3693-48e0-a161-912695caf60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:16.472946 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56e70b3-3693-48e0-a161-912695caf60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:16.478175 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c009d1-ed47-47b4-b174-38864cd81e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:16.492840 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c009d1-ed47-47b4-b174-38864cd81e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '28318cc5-ff77-436b-ba10-3ffb2383ad76', 'volume_name': 'volume-28318cc5-ff77-436b-ba10-3ffb2383ad76', 'volume_size': 1, 'source_volid': '06f2355f-dc98-4c01-a5f9-e2c295376722', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:16.497928 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a31f34-e933-4d62-b39d-143bf121577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:16.502519 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a31f34-e933-4d62-b39d-143bf121577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:16.507369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8368cceb-ebab-49d7-9539-7f7388cff9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:16.508498 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Volume 28318cc5-ff77-436b-ba10-3ffb2383ad76: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-28318cc5-ff77-436b-ba10-3ffb2383ad76', 'volume_size': 1, 'source_volid': '06f2355f-dc98-4c01-a5f9-e2c295376722', 'source_volstatus': 'available'} Mar 26 21:16:16.520513 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:16.588619 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] creating snapshot='volume-28318cc5-ff77-436b-ba10-3ffb2383ad76.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:16:16.940366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] cloning 'volume-06f2355f-dc98-4c01-a5f9-e2c295376722@volume-28318cc5-ff77-436b-ba10-3ffb2383ad76.clone_snap' to 'volume-28318cc5-ff77-436b-ba10-3ffb2383ad76' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:16:17.028561 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-745303625 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-745303625, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:17.048521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] Created reservations ['19c37a65-f60c-4475-9060-348b7f6eac30', '5589e44b-7152-4c66-b341-ede6f925f9e8', '16a71764-aa53-45f0-8c86-6ee21c89d571', '0cd84ffd-7052-42a7-bb5a-25af6de22084'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:17.096902 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ed5eb623-2225-4f6a-88a1-9d7284f92f9b tempest-GroupSnapshotsTest-989701389 None] group_snapshot ad7711f1-b4b9-472e-865d-9ec3eb81b2ab: deleted successfully Mar 26 21:16:17.183132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:17.184955 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:17.185506 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:17.207754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:16:17.208436 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Marking volume 28318cc5-ff77-436b-ba10-3ffb2383ad76 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:16:17.216681 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Copying metadata from source volume 06f2355f-dc98-4c01-a5f9-e2c295376722 to 28318cc5-ff77-436b-ba10-3ffb2383ad76. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}} Mar 26 21:16:17.248475 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8368cceb-ebab-49d7-9539-7f7388cff9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28318cc5-ff77-436b-ba10-3ffb2383ad76', 'volume_size': 1, 'source_volid': '06f2355f-dc98-4c01-a5f9-e2c295376722', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.253222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce71397-61f3-4ce8-a762-45c652ae02ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.261456 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Volume volume-28318cc5-ff77-436b-ba10-3ffb2383ad76 (28318cc5-ff77-436b-ba10-3ffb2383ad76): created successfully Mar 26 21:16:17.265750 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce71397-61f3-4ce8-a762-45c652ae02ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.271446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (ab3cf016-7e29-4c98-babc-c36a8bc281fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:17.284166 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-117f3dfd-34b0-425f-8d0c-6eeee6bf0fed tempest-VolumesCloneTest-1782489189 None] Created volume successfully. Mar 26 21:16:17.766398 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:17.785152 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (9c165edd-a4f4-4543-8b98-2d8a37403a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:17.793629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10358cf7-5fed-4a31-9c78-d65291902cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.808835 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10358cf7-5fed-4a31-9c78-d65291902cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-759165087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3a04363-0a2e-47dd-ae21-6e1f928001c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e98880faf84d28ad553bf14cd07acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:18Z,use_quota=True,user_id='c9c36d1ec4c1447da3add85c97535a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.814804 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f970c6-833c-46ee-b3f7-b0d4c4ac1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.819020 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f970c6-833c-46ee-b3f7-b0d4c4ac1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.824237 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721ffe1-5cae-4fef-9219-5f113b694078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.828969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721ffe1-5cae-4fef-9219-5f113b694078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a04363-0a2e-47dd-ae21-6e1f928001c8', 'volume_name': 'volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.833955 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d676307-db54-40e6-b342-8b8b42fe1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.837912 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d676307-db54-40e6-b342-8b8b42fe1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.842755 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1905339-e6c3-4ec5-b1fd-bfc6e1d2d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.843843 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Volume d3a04363-0a2e-47dd-ae21-6e1f928001c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8', 'volume_size': 1} Mar 26 21:16:17.844280 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] creating volume 'volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:17.845295 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:17.905941 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:17.906397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:17.910376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1905339-e6c3-4ec5-b1fd-bfc6e1d2d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.915019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f4751e-234f-44ef-bdc6-234c06524d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:17.923644 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Volume volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8 (d3a04363-0a2e-47dd-ae21-6e1f928001c8): created successfully Mar 26 21:16:17.927528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f4751e-234f-44ef-bdc6-234c06524d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:17.933361 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (9c165edd-a4f4-4543-8b98-2d8a37403a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:17.942264 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c0b3baec-e11f-4e04-a0ac-894c428dee84 tempest-VolumesCloneTest-1782489189 None] Created volume successfully. Mar 26 21:16:18.291622 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:18.346641 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:18.347012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Volume volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:18.353355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] deleting rbd volume volume-6ccfe2d4-4279-42c5-91f5-9ce2031d90c5 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:18.573832 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['fcfb831c-098d-4764-bcd0-0766ef96763c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:18.602216 ncdv-master-1 cinder-volume[134842]: WARNING cinder.db.sqlalchemy.api [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-745303625'] Mar 26 21:16:18.606381 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['22fa2f7b-75dc-48f8-83dd-d05638ffd5e1', '2bccc2fc-369d-4fe4-a707-132c9ce8ed47', '5a489630-c0c5-4b7b-ac3e-972b968596a5', '54422800-833e-4f77-9670-8e22ffa13078'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:18.681955 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:18.704384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:18.732635 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:18.738508 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a64c9656-b758-43b8-a94f-ddf4e8dc44c7 tempest-GroupSnapshotsTest-989701389 None] Delete group completed successfully. Mar 26 21:16:19.135030 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:19.165013 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (a705f384-6653-43f1-b311-b64bb454546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:19.171767 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b663e92-7dc4-4ec3-bc08-c6092ae6551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:19.188127 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b663e92-7dc4-4ec3-bc08-c6092ae6551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-948960838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ecc7be4-d392-4bce-8cec-85a07665ed9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e98880faf84d28ad553bf14cd07acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d3a04363-0a2e-47dd-ae21-6e1f928001c8,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:19Z,use_quota=True,user_id='c9c36d1ec4c1447da3add85c97535a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:19.193686 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c80adc-48f3-4810-898a-9ee95f8152bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:19.200198 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c80adc-48f3-4810-898a-9ee95f8152bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:19.206148 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfb0b8b-05de-489a-843f-032388d2e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:19.220841 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfb0b8b-05de-489a-843f-032388d2e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0ecc7be4-d392-4bce-8cec-85a07665ed9d', 'volume_name': 'volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d', 'volume_size': 2, 'source_volid': 'd3a04363-0a2e-47dd-ae21-6e1f928001c8', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:19.225831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a600f069-1add-4932-9c59-6562c4c10c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:19.229810 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a600f069-1add-4932-9c59-6562c4c10c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:19.234598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0d5143-f3be-47a9-a4d5-f679c917e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:19.235672 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Volume 0ecc7be4-d392-4bce-8cec-85a07665ed9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d', 'volume_size': 2, 'source_volid': 'd3a04363-0a2e-47dd-ae21-6e1f928001c8', 'source_volstatus': 'available'} Mar 26 21:16:19.246522 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:19.286405 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] creating snapshot='volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:16:19.964923 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] cloning 'volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8@volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d.clone_snap' to 'volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:16:19.980242 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-22bd4cf4-4594-4ac2-98f7-82196136c93c tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-576117881: creating Mar 26 21:16:20.000607 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-22bd4cf4-4594-4ac2-98f7-82196136c93c tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-576117881: created successfully Mar 26 21:16:20.012311 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-22bd4cf4-4594-4ac2-98f7-82196136c93c tempest-GroupSnapshotsTest-989701389 None] Create group completed successfully. Mar 26 21:16:20.092780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Volume volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:20.094348 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:20.094899 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:20.115495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] resize volume 'volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d' from 1 to 2 {{(pid=134842) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:742}} Mar 26 21:16:20.116266 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:20.214361 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:16:20.218378 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0d5143-f3be-47a9-a4d5-f679c917e796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d', 'volume_size': 2, 'source_volid': 'd3a04363-0a2e-47dd-ae21-6e1f928001c8', 'source_volstatus': 'available'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:20.223105 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed13256-5eda-404e-b650-2d1efa1669bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:20.231608 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Volume volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d (0ecc7be4-d392-4bce-8cec-85a07665ed9d): created successfully Mar 26 21:16:20.235568 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed13256-5eda-404e-b650-2d1efa1669bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:20.241158 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Flow 'volume_create_manager' (a705f384-6653-43f1-b311-b64bb454546b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:20.254287 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-06357b09-0141-4c7b-a888-5747e797afd8 tempest-VolumesCloneTest-1782489189 None] Created volume successfully. Mar 26 21:16:21.063624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:21.085320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (d6b4500f-192a-4112-b379-3f064727e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:21.091870 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be02603-6f48-4e52-94b1-9469ae4f2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.114304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be02603-6f48-4e52-94b1-9469ae4f2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-277443739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04f7f4bc-b487-45dd-907a-e596e50cbc86,host='ncdv-master-1@ceph#ceph',id=bf7026e2-d041-49c7-94d9-3a2c43a630d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119e0afe758a4e3c8aff0fe6f709cb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:21Z,use_quota=True,user_id='bf334063c524416f943d5a30581912cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5705df3a-b698-472c-9336-5bd4b0c05b74),volume_type_id=5705df3a-b698-472c-9336-5bd4b0c05b74)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.119773 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9199c43-601d-4ff5-9de2-023a39cdbc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.124088 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9199c43-601d-4ff5-9de2-023a39cdbc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.129306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223de00-5a65-47f4-9bed-3cb049b79b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.133730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223de00-5a65-47f4-9bed-3cb049b79b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7026e2-d041-49c7-94d9-3a2c43a630d2', 'volume_name': 'volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.140398 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fb309-13ed-48ef-8e20-42164070b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.144762 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fb309-13ed-48ef-8e20-42164070b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.152623 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0eb250-3bcd-4495-910b-559c9e96818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.154199 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Volume bf7026e2-d041-49c7-94d9-3a2c43a630d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2', 'volume_size': 1} Mar 26 21:16:21.154737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] creating volume 'volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:21.156317 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:21.241828 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:21.242473 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:21.252994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0eb250-3bcd-4495-910b-559c9e96818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.265982 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6423046b-150c-4cbb-b2a7-0a9d505906e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:21.277966 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Volume volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2 (bf7026e2-d041-49c7-94d9-3a2c43a630d2): created successfully Mar 26 21:16:21.284355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6423046b-150c-4cbb-b2a7-0a9d505906e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:21.292215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (d6b4500f-192a-4112-b379-3f064727e393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:21.302221 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8becd2c2-5a87-4a73-bf5c-4f4af52abfab tempest-GroupSnapshotsTest-989701389 None] Created volume successfully. Mar 26 21:16:21.338230 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-0ecc7be4-d392-4bce-8cec-85a07665ed9d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:21.381409 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:21.459781 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:21.468953 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] deleting rbd volume volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:21.680576 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:16:21.708661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Volume volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:21.709369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] deleting parent snapshot volume-0ecc7be4-d392-4bce-8cec-85a07665ed9d.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:16:22.040638 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Created reservations ['136c5f29-501f-482e-a2d3-401e60d573c7', '39c41e9f-4eb1-4a7a-ad01-a8586d324af1', 'ceeff771-86ac-433b-97c8-4603784f1aa8', 'a044abd2-b6b8-409d-85ba-d746772f6a86'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:22.089981 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:22.128528 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:22.161184 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:22.165295 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Deleted volume successfully. Mar 26 21:16:22.179312 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-255c69bc-3d69-463d-ad8f-494eea478c73 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-0ecc7be4-d392-4bce-8cec-85a07665ed9d-delete_volume'" released by "delete_volume" :: held 0.841s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:22.483714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:22.507556 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (8ad4075e-8901-43d1-ba4a-ed2501594913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:22.514172 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a856ce9-dd37-44a8-9e03-fc9824326a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.535402 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a856ce9-dd37-44a8-9e03-fc9824326a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-985689045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04f7f4bc-b487-45dd-907a-e596e50cbc86,host='ncdv-master-1@ceph#ceph',id=9be30700-7d56-41a4-9046-5695bc81b71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119e0afe758a4e3c8aff0fe6f709cb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:22Z,use_quota=True,user_id='bf334063c524416f943d5a30581912cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5705df3a-b698-472c-9336-5bd4b0c05b74),volume_type_id=5705df3a-b698-472c-9336-5bd4b0c05b74)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.541152 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382bdf1a-ec0f-4309-911d-8c3f6e50daa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.545677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382bdf1a-ec0f-4309-911d-8c3f6e50daa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.551108 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4548f318-f1e7-4a62-b771-5e6fb2868729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.555494 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4548f318-f1e7-4a62-b771-5e6fb2868729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be30700-7d56-41a4-9046-5695bc81b71a', 'volume_name': 'volume-9be30700-7d56-41a4-9046-5695bc81b71a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.560605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352daacd-796f-4b5a-99ee-9f601398f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.565368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352daacd-796f-4b5a-99ee-9f601398f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.570173 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90f7f33-f351-4133-ab0b-49db85c0e7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.571442 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Volume 9be30700-7d56-41a4-9046-5695bc81b71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be30700-7d56-41a4-9046-5695bc81b71a', 'volume_size': 1} Mar 26 21:16:22.571972 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] creating volume 'volume-9be30700-7d56-41a4-9046-5695bc81b71a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:22.572911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:22.601371 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-d3a04363-0a2e-47dd-ae21-6e1f928001c8-delete_volume'" acquired by "delete_volume" :: waited 0.079s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:22.636387 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:22.636763 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:22.641084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90f7f33-f351-4133-ab0b-49db85c0e7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be30700-7d56-41a4-9046-5695bc81b71a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.645679 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d9addf-ca05-47a3-86c8-f4178451036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:22.652655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:22.693007 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:22.693441 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Volume volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:22.698999 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] deleting rbd volume volume-d3a04363-0a2e-47dd-ae21-6e1f928001c8 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:22.701087 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Volume volume-9be30700-7d56-41a4-9046-5695bc81b71a (9be30700-7d56-41a4-9046-5695bc81b71a): created successfully Mar 26 21:16:22.705337 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d9addf-ca05-47a3-86c8-f4178451036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:22.710849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (8ad4075e-8901-43d1-ba4a-ed2501594913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:22.721988 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7e45b843-d00b-4cb4-a0e7-acd75af4e6b4 tempest-GroupSnapshotsTest-989701389 None] Created volume successfully. Mar 26 21:16:22.913454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Created reservations ['3421e0f6-ca95-4fcf-82f0-4197959cfb24', 'cf58bb44-de71-4069-8ad7-0d2a067dad66', 'f38dcf75-450c-4c7f-a059-c9c5e69013d0', '7ccf4f89-6d67-4c2f-bf31-216bc1bb5444'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:22.969215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:22.990523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:23.022842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:23.026845 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Deleted volume successfully. Mar 26 21:16:23.040095 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-1ce203a2-32bf-4421-822d-7231cdf07869 tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-d3a04363-0a2e-47dd-ae21-6e1f928001c8-delete_volume'" released by "delete_volume" :: held 0.439s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:23.659352 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-26da31c0-0894-4b15-a7b5-5a326dcd61c5 tempest-GroupSnapshotsTest-989701389 None] Update group completed successfully. Mar 26 21:16:23.660907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-28318cc5-ff77-436b-ba10-3ffb2383ad76-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:23.697376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:23.780495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:23.787873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] deleting rbd volume volume-28318cc5-ff77-436b-ba10-3ffb2383ad76 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:23.953652 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:16:24.002141 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] deleting parent snapshot volume-28318cc5-ff77-436b-ba10-3ffb2383ad76.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:16:25.106167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] Created reservations ['ce47e620-c538-475a-89ca-1b987bfb6285', '4418b75f-1e42-49c5-a74c-0ed0a54d4384', '71486046-675f-4ac5-9f61-852cd2ae9b55', '9c42af54-a7fa-474a-a232-ff65499536a5'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:25.129683 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7d5989f6-2520-4dc4-bbc9-b054d50dbee3 tempest-GroupSnapshotsTest-989701389 None] Update group completed successfully. Mar 26 21:16:25.159060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:25.187363 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:25.234115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:25.238053 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] Deleted volume successfully. Mar 26 21:16:25.251678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-aef65d16-0165-4b4c-84da-d3b43a79e08e tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-28318cc5-ff77-436b-ba10-3ffb2383ad76-delete_volume'" released by "delete_volume" :: held 1.590s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:25.838257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-06f2355f-dc98-4c01-a5f9-e2c295376722-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:25.903086 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:25.970248 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:25.979236 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] deleting rbd volume volume-06f2355f-dc98-4c01-a5f9-e2c295376722 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:26.020690 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5d273100-041a-4fec-bbc9-e1a12dbd1823 tempest-GroupSnapshotsTest-989701389 None] Update group completed successfully. Mar 26 21:16:26.189636 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:16:26.220148 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] deleting parent snapshot volume-06f2355f-dc98-4c01-a5f9-e2c295376722.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:16:27.120438 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] Created reservations ['813d97eb-50c3-420f-b1a1-7e1dbfcac6f5', '00dda36f-ece2-497d-a92a-5642b6772522', '4ca3b115-7b1f-4b86-90d2-685c791d4761', '306a0975-ebad-402e-ae35-18683be51b40'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:27.137732 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-60bf79ba-0012-4458-aaae-2f9b7b2eb648 tempest-GroupSnapshotsTest-989701389 None] Update group completed successfully. Mar 26 21:16:27.174624 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:27.199175 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:27.223744 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:27.228000 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] Deleted volume successfully. Mar 26 21:16:27.240015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-74a27a8f-609d-43d5-945f-b621bc609a1d tempest-VolumesCloneTest-1782489189 None] Lock "b'cinder-06f2355f-dc98-4c01-a5f9-e2c295376722-delete_volume'" released by "delete_volume" :: held 1.402s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:28.431473 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8b36dabe-0fc6-408c-b6f7-0f569ef8eedb tempest-GroupSnapshotsTest-989701389 None] GroupSnapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: creating. Mar 26 21:16:28.455675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8b36dabe-0fc6-408c-b6f7-0f569ef8eedb tempest-GroupSnapshotsTest-989701389 None] Group snapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: creating. {{(pid=134842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 26 21:16:28.476629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8b36dabe-0fc6-408c-b6f7-0f569ef8eedb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:29.096573 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8b36dabe-0fc6-408c-b6f7-0f569ef8eedb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:30.209163 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8b36dabe-0fc6-408c-b6f7-0f569ef8eedb tempest-GroupSnapshotsTest-989701389 None] group_snapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: created successfully Mar 26 21:16:30.673962 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] group_snapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: deleting Mar 26 21:16:30.695692 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] group_snapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: deleting {{(pid=134842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 26 21:16:30.713531 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:30.986474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:32.205720 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1833137983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1833137983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:32.207267 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1833137983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1833137983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:32.225910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['1d2db627-ae96-4aaf-9d33-c39121635505', '9d7d3933-e8db-4519-b62f-7d12055e437d', '9bcc8a99-30c3-4400-99fe-33408fbec14a', '0e33bbcd-8c55-47f3-b1cf-810263a6150a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:32.320427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['a206943c-3339-4b47-9876-7cc7242ec193', '9e955c93-14e0-4d84-91c7-9fc872c5ed1d', 'ae6af23c-27f9-40ee-8319-f50fa0f68b78', 'c71a8ed8-cb0a-4314-84ac-ba8abe85b3a0'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:32.367376 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-91add5a2-97aa-4792-aef7-368f1cf7b5d2 tempest-GroupSnapshotsTest-989701389 None] group_snapshot 00f9c334-ed37-4877-b9d2-feaf325aff04: deleted successfully Mar 26 21:16:33.270629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:33.324991 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:33.325547 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Volume volume-9be30700-7d56-41a4-9046-5695bc81b71a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:33.331482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] deleting rbd volume volume-9be30700-7d56-41a4-9046-5695bc81b71a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:33.500893 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:33.539032 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:33.539736 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Volume volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:33.545110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] deleting rbd volume volume-bf7026e2-d041-49c7-94d9-3a2c43a630d2 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:33.790501 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Created reservations ['f3361683-5fe2-4c66-b7f1-a83f38efebac'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:33.808852 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1833137983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1833137983, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:33.822689 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Created reservations ['60ce1c61-6111-4f2d-84a5-b398d3275493', 'd51a3c92-8e05-4cb1-963e-ed97ecfa90d2', 'd91431e5-e263-4729-9500-b3568c0eeea2', '84ad3179-dea1-413a-aa05-7772c3569edb'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:33.901618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Created reservations ['85510a73-089a-420a-936b-c1317abdeff0', 'db2b8adb-c9d7-49a2-b7fb-c8af91118a00', '9139f00a-f891-4212-93da-94e719d83328', 'a6433f92-25c0-4293-9609-a3b81325bf47'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:34.012382 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:34.049999 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:34.121637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:34.131863 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1ba0ac0a-83e3-42b8-97f8-b0069e3db4bb tempest-GroupSnapshotsTest-989701389 None] Delete group completed successfully. Mar 26 21:16:34.712437 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fa981486-b90d-4abe-8022-7c5c110c4deb tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-1794701444: creating Mar 26 21:16:34.741091 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fa981486-b90d-4abe-8022-7c5c110c4deb tempest-GroupSnapshotsTest-989701389 None] Group tempest-GroupSnapshotsTest-Group-1794701444: created successfully Mar 26 21:16:34.759392 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fa981486-b90d-4abe-8022-7c5c110c4deb tempest-GroupSnapshotsTest-989701389 None] Create group completed successfully. Mar 26 21:16:36.218024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:36.238273 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (8f3b2e1a-4468-428a-808a-a9a3a1ba51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:36.245511 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ecea27-aa99-4349-901e-cc5c2950a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.267211 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ecea27-aa99-4349-901e-cc5c2950a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-572317562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9bce921b-8936-4d5f-b37c-e407fb24f23f,host='ncdv-master-1@ceph#ceph',id=fade4045-8f7b-4f19-a6a6-fbe914aea59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119e0afe758a4e3c8aff0fe6f709cb22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:36Z,use_quota=True,user_id='bf334063c524416f943d5a30581912cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ca1761f-b872-4c02-ad70-90451dcd4f6d),volume_type_id=3ca1761f-b872-4c02-ad70-90451dcd4f6d)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.272976 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef9d123-92a7-4f8b-a926-4e96b07d6fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.277706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef9d123-92a7-4f8b-a926-4e96b07d6fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.283628 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1872db6-ab96-4521-a47e-6eb376d180c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.288297 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1872db6-ab96-4521-a47e-6eb376d180c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fade4045-8f7b-4f19-a6a6-fbe914aea59f', 'volume_name': 'volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.293358 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b19e318-7c25-455d-8042-a448cd2183ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.297601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b19e318-7c25-455d-8042-a448cd2183ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.302821 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324f4520-9c0a-47a4-9727-471465b3eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.304199 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Volume fade4045-8f7b-4f19-a6a6-fbe914aea59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f', 'volume_size': 1} Mar 26 21:16:36.304731 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] creating volume 'volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:36.305757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:36.407708 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:36.408250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] extra_specs: {} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:36.434461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324f4520-9c0a-47a4-9727-471465b3eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.444096 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973cd8a-da46-4607-ba7b-7b0772b871d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:36.454628 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Volume volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f (fade4045-8f7b-4f19-a6a6-fbe914aea59f): created successfully Mar 26 21:16:36.458940 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973cd8a-da46-4607-ba7b-7b0772b871d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:36.464837 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Flow 'volume_create_manager' (8f3b2e1a-4468-428a-808a-a9a3a1ba51fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:36.484838 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-6159245e-409c-493c-b697-55bb99b80e80 tempest-GroupSnapshotsTest-989701389 None] Created volume successfully. Mar 26 21:16:37.570494 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-26fccde3-10cb-4434-b857-a9434a4b8358 tempest-GroupSnapshotsTest-989701389 None] GroupSnapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: creating. Mar 26 21:16:37.604175 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-26fccde3-10cb-4434-b857-a9434a4b8358 tempest-GroupSnapshotsTest-989701389 None] Group snapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: creating. {{(pid=134842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}} Mar 26 21:16:37.629585 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-26fccde3-10cb-4434-b857-a9434a4b8358 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:38.320322 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-26fccde3-10cb-4434-b857-a9434a4b8358 tempest-GroupSnapshotsTest-989701389 None] group_snapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: created successfully Mar 26 21:16:38.940902 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] group_snapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: deleting Mar 26 21:16:38.988956 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] group_snapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: deleting {{(pid=134842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}} Mar 26 21:16:39.037702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:40.388959 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-485423012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-485423012, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:40.391884 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-485423012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-485423012, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:40.414395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['2d002e8a-9606-49cb-bc6b-fc39dd592168', '34706ab4-045a-482d-bd18-a200726049b3', '49b29aad-7e69-4e9e-bf00-5fc2d154249e', 'd876cd67-1bc6-450f-a41c-e024195f6c0c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:40.465007 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8186251f-2157-4a2c-9756-c6d3b2b399e9 tempest-GroupSnapshotsTest-989701389 None] group_snapshot ed7f4c5b-866f-4fd6-8972-0a7fb3db9ac3: deleted successfully Mar 26 21:16:41.586783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:41.668290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:41.668290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Volume volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:41.675422 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] deleting rbd volume volume-fade4045-8f7b-4f19-a6a6-fbe914aea59f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:42.049611 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['faa7f6c3-ae3e-45f1-b0dc-0c2c67feeda7'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:42.067899 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-485423012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-485423012, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:16:42.084681 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Created reservations ['a08848af-c9fe-4834-8b7f-3417009cf151', '54bf5ead-f3f5-48d3-ba04-4e429a9e2745', '713c9df7-343e-418f-8c10-20147d88b5a7', 'd56d4a95-e617-4fee-9733-c00ae15010d2'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:42.180169 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:42.219941 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:42.251951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:42.257155 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3bbfa1d4-55ff-4db0-9768-0c4605bdb181 tempest-GroupSnapshotsTest-989701389 None] Delete group completed successfully. Mar 26 21:16:53.205445 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:53.226379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Flow 'volume_create_manager' (0b6624c3-e6b3-4bbe-b843-76f192714acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:53.234861 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b23bc2-351a-4850-9d81-03f371d0b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.255039 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b23bc2-351a-4850-9d81-03f371d0b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-484772867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ad585e0f-56d0-4864-b5c5-8d8f92176862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa6ac8cc2334460aa71aa6271be99657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:16:53Z,use_quota=True,user_id='902fbbde71b24a3488eca13596a67833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.261707 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7420eb2a-854a-4aa7-94d1-497500d67a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.267367 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7420eb2a-854a-4aa7-94d1-497500d67a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.273524 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61814f1a-7eb2-4acb-824f-df3cdd95af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.278417 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61814f1a-7eb2-4acb-824f-df3cdd95af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad585e0f-56d0-4864-b5c5-8d8f92176862', 'volume_name': 'volume-ad585e0f-56d0-4864-b5c5-8d8f92176862', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.285824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eaa72c-229d-45b0-91ab-89f607d81bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.297182 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eaa72c-229d-45b0-91ab-89f607d81bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.304881 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a164a12-382c-429b-9eaf-31fa2c58a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.306102 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Volume ad585e0f-56d0-4864-b5c5-8d8f92176862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad585e0f-56d0-4864-b5c5-8d8f92176862', 'volume_size': 1} Mar 26 21:16:53.306647 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] creating volume 'volume-ad585e0f-56d0-4864-b5c5-8d8f92176862' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:16:53.307446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:53.390680 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:16:53.391266 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:16:53.397132 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a164a12-382c-429b-9eaf-31fa2c58a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad585e0f-56d0-4864-b5c5-8d8f92176862', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.404292 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62149884-b987-4650-8d3e-ae2a483d73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:53.415703 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Volume volume-ad585e0f-56d0-4864-b5c5-8d8f92176862 (ad585e0f-56d0-4864-b5c5-8d8f92176862): created successfully Mar 26 21:16:53.423178 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62149884-b987-4650-8d3e-ae2a483d73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:53.430554 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Flow 'volume_create_manager' (0b6624c3-e6b3-4bbe-b843-76f192714acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:53.440768 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-4cd4507f-9b66-4dde-845f-54c7e151489b tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Created volume successfully. Mar 26 21:16:54.901336 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Lock "b'cinder-ad585e0f-56d0-4864-b5c5-8d8f92176862-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:16:54.932765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:54.971524 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:16:54.972349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Volume volume-ad585e0f-56d0-4864-b5c5-8d8f92176862 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:16:54.999201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] deleting rbd volume volume-ad585e0f-56d0-4864-b5c5-8d8f92176862 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:16:55.230091 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Created reservations ['b0702504-03ad-497d-add1-8c4a561e4489', '93a68c11-acb9-4a52-a100-08e12bf891d6', '23382011-f9d5-4e5f-b250-b76f6313cfaa', '3fcc24ed-4e63-4451-813a-9811fd8b2ddc'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:16:55.276732 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:55.304098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:55.335766 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:55.341588 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Deleted volume successfully. Mar 26 21:16:55.354146 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-acb13e16-2cf2-4340-a828-0125f11afd6f tempest-VolumeQuotasNegativeTestJSON-1907738684 None] Lock "b'cinder-ad585e0f-56d0-4864-b5c5-8d8f92176862-delete_volume'" released by "delete_volume" :: held 0.453s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:16:58.290519 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:16:58.291621 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:58.329783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:16:58.380057 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:16:59.907355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:16:59.927385 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Flow 'volume_create_manager' (5ec6f8d5-d379-4729-8122-0050402f11d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:16:59.933970 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1f4023-bd40-48bd-9777-4b47539dcd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:59.957566 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1f4023-bd40-48bd-9777-4b47539dcd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-704818081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3fd7d14e-005e-450b-9b1f-6587e5bb41fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2aae09addd4e8f8c67112a16fd6b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:00Z,use_quota=True,user_id='9ab3dfeb7c5f416ba0a4a0cf2c986ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(266c50d1-b2f7-4408-b9f3-7088f6ce5968),volume_type_id=266c50d1-b2f7-4408-b9f3-7088f6ce5968)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:59.969515 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3e49b5-2afc-4fb3-8c30-84aaf2dd2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:16:59.977631 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3e49b5-2afc-4fb3-8c30-84aaf2dd2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:16:59.994869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70031e5c-55c2-49f9-8e28-8449d663641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:00.002853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70031e5c-55c2-49f9-8e28-8449d663641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd7d14e-005e-450b-9b1f-6587e5bb41fe', 'volume_name': 'volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:00.012421 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5997b1fc-344f-4fef-bf33-7a5ddee932d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:00.020267 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5997b1fc-344f-4fef-bf33-7a5ddee932d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:00.030041 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57529518-fd98-417d-93d0-64251ddde23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:00.031860 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Volume 3fd7d14e-005e-450b-9b1f-6587e5bb41fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe', 'volume_size': 1} Mar 26 21:17:00.032511 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] creating volume 'volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:00.033763 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:00.116104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:00.119119 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:00.123222 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57529518-fd98-417d-93d0-64251ddde23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:00.128486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d519a-1ab1-45a8-8abd-eeb9cd3fe7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:00.138500 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Volume volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe (3fd7d14e-005e-450b-9b1f-6587e5bb41fe): created successfully Mar 26 21:17:00.142854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738d519a-1ab1-45a8-8abd-eeb9cd3fe7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:00.148503 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Flow 'volume_create_manager' (5ec6f8d5-d379-4729-8122-0050402f11d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:00.157478 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b3c991f8-d12c-4f3c-9c32-dd9eaed92606 tempest-VolumeTypesTest-2065257787 None] Created volume successfully. Mar 26 21:17:01.224509 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5400be79-012a-4e7b-9e0e-6f04fc48384b tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:01.250883 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5400be79-012a-4e7b-9e0e-6f04fc48384b tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:01.275171 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5400be79-012a-4e7b-9e0e-6f04fc48384b tempest-VolumeTypesTest-2065257787 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:01.280384 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5400be79-012a-4e7b-9e0e-6f04fc48384b tempest-VolumeTypesTest-2065257787 None] Retype volume completed successfully. Mar 26 21:17:03.284216 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Lock "b'cinder-3fd7d14e-005e-450b-9b1f-6587e5bb41fe-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:03.322727 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:03.358643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:03.359103 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Volume volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:03.363445 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] deleting rbd volume volume-3fd7d14e-005e-450b-9b1f-6587e5bb41fe {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:03.555962 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1317848516 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1317848516, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:17:03.556713 ncdv-master-1 cinder-volume[134842]: WARNING cinder.quota [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1317848516 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1317848516, it is now deprecated. Please use the default quota class for default quota. Mar 26 21:17:03.571013 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Created reservations ['b2036fe4-d22a-4ae7-bb32-333e789cd6ab', '5a176155-ac9e-4020-b463-f096e93da919', '7cdd0b29-0a49-4c27-a200-a795478a3a0d', '71a9aa46-928d-4460-8c6c-54b4e0454d0a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:03.615614 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:03.651453 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:03.679807 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:03.685573 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Deleted volume successfully. Mar 26 21:17:03.697572 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5c2a2ac6-5be2-47a0-a56d-1650bd35c414 tempest-VolumeTypesTest-2065257787 None] Lock "b'cinder-3fd7d14e-005e-450b-9b1f-6587e5bb41fe-delete_volume'" released by "delete_volume" :: held 0.413s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:10.522785 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:10.542230 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (e5351da8-ad40-4fb8-b114-1fd33934cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:10.549706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10eab15c-7564-43d6-a436-95a518ddea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.565321 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10eab15c-7564-43d6-a436-95a518ddea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1548533448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b669f91-be81-47a4-af6b-692e4288c80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8186063bcad64e01aaac232da670fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:10Z,use_quota=True,user_id='4c2951d0babd4eb2a318f9f847477f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.570782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e257fcb-d615-425a-b0b5-5c4ca296c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.575015 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e257fcb-d615-425a-b0b5-5c4ca296c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.580298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd99f39-e1c5-4512-bc17-43f37fcaa8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.584422 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd99f39-e1c5-4512-bc17-43f37fcaa8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b669f91-be81-47a4-af6b-692e4288c80b', 'volume_name': 'volume-3b669f91-be81-47a4-af6b-692e4288c80b', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.589442 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2708d78a-23c4-4639-8a44-196187cbe8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.593404 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2708d78a-23c4-4639-8a44-196187cbe8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.598202 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd44487-7518-4bf2-998e-ba4c2d71ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.599281 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Volume 3b669f91-be81-47a4-af6b-692e4288c80b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b669f91-be81-47a4-af6b-692e4288c80b', 'volume_size': 1} Mar 26 21:17:10.599675 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] creating volume 'volume-3b669f91-be81-47a4-af6b-692e4288c80b' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:10.600480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:10.652757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:10.653400 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:10.657210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd44487-7518-4bf2-998e-ba4c2d71ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b669f91-be81-47a4-af6b-692e4288c80b', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.661833 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb10fbe-6a61-427e-b334-1466cb02c94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:10.671591 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-3b669f91-be81-47a4-af6b-692e4288c80b (3b669f91-be81-47a4-af6b-692e4288c80b): created successfully Mar 26 21:17:10.675688 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb10fbe-6a61-427e-b334-1466cb02c94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:10.681185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (e5351da8-ad40-4fb8-b114-1fd33934cad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:10.689921 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d7cf80fb-8316-4897-bbf6-193ba2329231 tempest-VolumesBackupsAdminTest-228261023 None] Created volume successfully. Mar 26 21:17:11.715143 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:17:11Z,data_timestamp=2022-03-26T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1580242957',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e353488c-2a1d-43e9-ab40-d3010695def3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8186063bcad64e01aaac232da670fcb2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4c2951d0babd4eb2a318f9f847477f71',volume_id=3b669f91-be81-47a4-af6b-692e4288c80b) Mar 26 21:17:11.715899 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] continue_backup in rpcapi backup_id e353488c-2a1d-43e9-ab40-d3010695def3 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:17:11.877208 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:17:12.538414 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.661s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:17:12.539352 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3b669f91-be81-47a4-af6b-692e4288c80b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '3b669f91-be81-47a4-af6b-692e4288c80b', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:17:12.554151 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] Initialize volume connection completed successfully. Mar 26 21:17:14.279543 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] Terminate volume connection completed successfully. Mar 26 21:17:14.298120 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a13d924d-e79e-4930-b905-211bafe94647 tempest-VolumesBackupsAdminTest-228261023 None] Remove volume export completed successfully. Mar 26 21:17:16.462019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:16.483446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (554bafd8-c61d-4a65-b5a8-d21231ec4c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:16.490260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8258c508-a234-4c8e-8f3f-45f3b932abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.505458 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8258c508-a234-4c8e-8f3f-45f3b932abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:16Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e353488c-2a1d-43e9-ab40-d3010695def3',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=070cb53b-b3a8-49f0-bd7e-156bddf48e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8186063bcad64e01aaac232da670fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:16Z,use_quota=True,user_id='4c2951d0babd4eb2a318f9f847477f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.510962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ae6709-3396-4e2c-a949-b0f7ade837bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.515718 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ae6709-3396-4e2c-a949-b0f7ade837bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.520994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266eec78-839b-44d7-8251-8d08a1ac6bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.525217 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266eec78-839b-44d7-8251-8d08a1ac6bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'volume_name': 'volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.530842 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9fa672-f412-4d92-ab30-e7a513fa5080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.535012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9fa672-f412-4d92-ab30-e7a513fa5080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.540076 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1cf363-6a52-4e79-a596-b58e59657b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.541185 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Volume 070cb53b-b3a8-49f0-bd7e-156bddf48e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'volume_size': 1} Mar 26 21:17:16.541601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] creating volume 'volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:16.542801 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:16.602580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:16.602966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:16.606874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1cf363-6a52-4e79-a596-b58e59657b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.611747 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090722fb-d0b5-4311-b1ae-f981e978e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:16.622088 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43 (070cb53b-b3a8-49f0-bd7e-156bddf48e43): created successfully Mar 26 21:17:16.626237 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090722fb-d0b5-4311-b1ae-f981e978e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:16.632059 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (554bafd8-c61d-4a65-b5a8-d21231ec4c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:16.642184 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Created volume successfully. Mar 26 21:17:17.545710 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:17:18.198139 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:17:18.198958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '070cb53b-b3a8-49f0-bd7e-156bddf48e43', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:17:18.214504 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Initialize volume connection completed successfully. Mar 26 21:17:19.364474 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Terminate volume connection completed successfully. Mar 26 21:17:19.382446 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c3bd668-6e3c-41a6-b975-f4aa428c86dd tempest-VolumesBackupsAdminTest-228261023 None] Remove volume export completed successfully. Mar 26 21:17:19.686122 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-070cb53b-b3a8-49f0-bd7e-156bddf48e43-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:19.731558 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:20.210906 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:20.227477 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] deleting rbd volume volume-070cb53b-b3a8-49f0-bd7e-156bddf48e43 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:20.436396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Created reservations ['e60bdfe4-2b62-483b-944b-0748a566fc29', '53b3329c-6e3b-462e-aedf-1e98d83329ac', '6c8c026a-f87c-452b-94b7-49b07f0191db', '174dae0b-02bf-4aff-863d-8b22cd012e89'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:20.503502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:20.529267 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:20.556575 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:20.560706 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Deleted volume successfully. Mar 26 21:17:20.573776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-db71b1b9-250f-48c9-80b9-9e689b9a431e tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-070cb53b-b3a8-49f0-bd7e-156bddf48e43-delete_volume'" released by "delete_volume" :: held 0.888s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:22.276947 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:22.303683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (6bd92d9a-ac38-48e4-bed8-3c445cb28e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:22.311594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4eb4f27-63a2-4d17-af48-d9deddaa9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.335759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4eb4f27-63a2-4d17-af48-d9deddaa9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1739295576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a13b1b5-3010-42dd-9829-45b35909b8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8186063bcad64e01aaac232da670fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:22Z,use_quota=True,user_id='4c2951d0babd4eb2a318f9f847477f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.343656 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1d9bb1-4189-404d-b54e-0db1d70b2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.349322 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1d9bb1-4189-404d-b54e-0db1d70b2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.356264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb1a2a6-8ce6-4240-aed7-5aa4c0a30e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.360568 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb1a2a6-8ce6-4240-aed7-5aa4c0a30e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a13b1b5-3010-42dd-9829-45b35909b8db', 'volume_name': 'volume-8a13b1b5-3010-42dd-9829-45b35909b8db', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.365674 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14da1d8e-a1a5-4000-8554-945e8c62667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.369746 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14da1d8e-a1a5-4000-8554-945e8c62667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.376017 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3adb07-88f7-4228-950e-a3826a388ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.377167 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Volume 8a13b1b5-3010-42dd-9829-45b35909b8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a13b1b5-3010-42dd-9829-45b35909b8db', 'volume_size': 1} Mar 26 21:17:22.378110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] creating volume 'volume-8a13b1b5-3010-42dd-9829-45b35909b8db' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:22.379456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:22.435523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:22.435735 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:22.439689 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3adb07-88f7-4228-950e-a3826a388ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a13b1b5-3010-42dd-9829-45b35909b8db', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.444281 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95c842-bf0a-45c7-bec3-2376e1edf2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:22.452707 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-8a13b1b5-3010-42dd-9829-45b35909b8db (8a13b1b5-3010-42dd-9829-45b35909b8db): created successfully Mar 26 21:17:22.456308 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95c842-bf0a-45c7-bec3-2376e1edf2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:22.461938 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Flow 'volume_create_manager' (6bd92d9a-ac38-48e4-bed8-3c445cb28e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:22.470642 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c835c2f2-7dd4-40fe-86b0-acaf45ca007d tempest-VolumesBackupsAdminTest-228261023 None] Created volume successfully. Mar 26 21:17:23.398120 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:17:23Z,data_timestamp=2022-03-26T21:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-801704782',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=60c8343b-0eaa-42bf-878d-d87dcd0f4253,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8186063bcad64e01aaac232da670fcb2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4c2951d0babd4eb2a318f9f847477f71',volume_id=8a13b1b5-3010-42dd-9829-45b35909b8db) Mar 26 21:17:23.398907 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] continue_backup in rpcapi backup_id 60c8343b-0eaa-42bf-878d-d87dcd0f4253 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:17:23.520160 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:17:24.163691 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:17:24.164859 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8a13b1b5-3010-42dd-9829-45b35909b8db', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '8a13b1b5-3010-42dd-9829-45b35909b8db', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:17:24.179845 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] Initialize volume connection completed successfully. Mar 26 21:17:26.135742 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] Terminate volume connection completed successfully. Mar 26 21:17:26.156669 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9a836ee2-bce6-4670-8cc4-1b863486ef4c tempest-VolumesBackupsAdminTest-228261023 None] Remove volume export completed successfully. Mar 26 21:17:27.746629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-8a13b1b5-3010-42dd-9829-45b35909b8db-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:27.789702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:28.335687 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-8a13b1b5-3010-42dd-9829-45b35909b8db is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:28.354260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] deleting rbd volume volume-8a13b1b5-3010-42dd-9829-45b35909b8db {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:28.630346 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Created reservations ['30ccd1af-bd4a-42ee-8e19-523ac71be945', '6ee7597f-f633-4d69-bc18-6b4573fe5a31', '9d318db9-8316-4523-a6c5-ddd6d700a70b', '6cfa7d82-a731-41f4-8d43-f18b5db5a50b'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:28.678583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:28.702601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:28.739191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:28.743508 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Deleted volume successfully. Mar 26 21:17:28.756400 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-3754d910-f1ab-4d91-b6db-4e54e9fd6463 tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-8a13b1b5-3010-42dd-9829-45b35909b8db-delete_volume'" released by "delete_volume" :: held 1.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:28.897305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-3b669f91-be81-47a4-af6b-692e4288c80b-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:28.940710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:29.365904 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Volume volume-3b669f91-be81-47a4-af6b-692e4288c80b is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:29.393292 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] deleting rbd volume volume-3b669f91-be81-47a4-af6b-692e4288c80b {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:29.666173 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Created reservations ['e1d518d6-cc10-4f40-987b-b404d0a63747', '90300c3d-27e5-4eac-bc74-2f1f23b54bf6', '10d70866-5946-4d1f-98c4-636f68f6eab2', '5b81d163-22ab-4b36-a55d-9c0e7d495792'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:29.725245 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:29.758788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:29.785218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:29.790284 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Deleted volume successfully. Mar 26 21:17:29.804808 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9c9a2546-4d0f-4c58-8448-2d7caf850b0a tempest-VolumesBackupsAdminTest-228261023 None] Lock "b'cinder-3b669f91-be81-47a4-af6b-692e4288c80b-delete_volume'" released by "delete_volume" :: held 0.909s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:33.291062 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:33.328280 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (73ecc0ef-3c41-4abd-bd6b-23558d31a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:33.336744 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ca63bf-d582-4030-b58b-9c82b1f34e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.355167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ca63bf-d582-4030-b58b-9c82b1f34e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-285133290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d8c266ef-0d89-4aea-a9ad-76b2c0b48705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2dc693fa9243e8b68eb9ff4a5c2d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:33Z,use_quota=True,user_id='8dc229bba13b494dbbaf683ec3b1eb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.362027 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cf7a7a-09a7-42f6-8a81-c0e875a8d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.366449 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cf7a7a-09a7-42f6-8a81-c0e875a8d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.373045 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f0cd4a-4b98-42e0-b7fd-7da878104119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.377869 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f0cd4a-4b98-42e0-b7fd-7da878104119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c266ef-0d89-4aea-a9ad-76b2c0b48705', 'volume_name': 'volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.383393 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbe3702-3b05-4c5d-a8db-d03de5c00e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.388951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbe3702-3b05-4c5d-a8db-d03de5c00e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.394653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3b2ea8-1b51-4b3e-bf16-3d397f9ec377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.395845 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Volume d8c266ef-0d89-4aea-a9ad-76b2c0b48705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705', 'volume_size': 1} Mar 26 21:17:33.396363 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] creating volume 'volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:33.397204 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:33.485733 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:33.486116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:33.491131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3b2ea8-1b51-4b3e-bf16-3d397f9ec377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.497642 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908236f-153b-465a-bf18-f09bd87dfd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:33.507979 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705 (d8c266ef-0d89-4aea-a9ad-76b2c0b48705): created successfully Mar 26 21:17:33.513350 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908236f-153b-465a-bf18-f09bd87dfd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:33.519264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (73ecc0ef-3c41-4abd-bd6b-23558d31a815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:33.529081 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-02f4601f-527e-441a-be95-35feb6f4dfc0 tempest-VolumesListAdminTestJSON-159480450 None] Created volume successfully. Mar 26 21:17:34.651814 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:34.672144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (0b0670d6-9e81-4718-8d80-2be709440162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:34.679355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e530f7-2c8a-4b8c-b273-a35ef6514054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.695857 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e530f7-2c8a-4b8c-b273-a35ef6514054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890435142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=61e3eed4-d127-463b-ae16-55efa79ca94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2dc693fa9243e8b68eb9ff4a5c2d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:35Z,use_quota=True,user_id='8dc229bba13b494dbbaf683ec3b1eb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.701464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc562c-6229-44c4-8193-95d4a2b002e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.705747 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc562c-6229-44c4-8193-95d4a2b002e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.711062 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306a796e-93b4-4027-a56d-cf298f225716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.715338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306a796e-93b4-4027-a56d-cf298f225716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e3eed4-d127-463b-ae16-55efa79ca94f', 'volume_name': 'volume-61e3eed4-d127-463b-ae16-55efa79ca94f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.720658 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f07c3f-1916-46c1-a36b-b3d7c9463d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.724722 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f07c3f-1916-46c1-a36b-b3d7c9463d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.729574 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d8e85f-ae82-4daa-92b0-892c9c13d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.731242 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Volume 61e3eed4-d127-463b-ae16-55efa79ca94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e3eed4-d127-463b-ae16-55efa79ca94f', 'volume_size': 1} Mar 26 21:17:34.731652 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] creating volume 'volume-61e3eed4-d127-463b-ae16-55efa79ca94f' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:34.732368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:34.812412 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:34.812883 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:34.817599 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d8e85f-ae82-4daa-92b0-892c9c13d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e3eed4-d127-463b-ae16-55efa79ca94f', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.822623 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed96ff80-306a-409a-aff4-804cc1cdf948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:34.832536 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-61e3eed4-d127-463b-ae16-55efa79ca94f (61e3eed4-d127-463b-ae16-55efa79ca94f): created successfully Mar 26 21:17:34.837176 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed96ff80-306a-409a-aff4-804cc1cdf948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:34.843104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (0b0670d6-9e81-4718-8d80-2be709440162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:34.852766 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-507b2579-70cc-46db-9137-c92e51551d8e tempest-VolumesListAdminTestJSON-159480450 None] Created volume successfully. Mar 26 21:17:36.063069 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:36.083535 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (0d09d4d8-5eb3-4d3c-9802-c9720d545cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:36.090206 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb4d9b7-a1e0-4c26-bec8-530b277de737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.105952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb4d9b7-a1e0-4c26-bec8-530b277de737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620960496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=55b43f1d-6804-42cd-977d-7eb3aa8d0f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2dc693fa9243e8b68eb9ff4a5c2d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:36Z,use_quota=True,user_id='8dc229bba13b494dbbaf683ec3b1eb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.111495 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e4955-c796-4d9f-8b40-6b6592f45856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.115805 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e4955-c796-4d9f-8b40-6b6592f45856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.121789 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04fb2b0-8784-44cb-a4e3-02988fca8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.126013 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04fb2b0-8784-44cb-a4e3-02988fca8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b43f1d-6804-42cd-977d-7eb3aa8d0f6d', 'volume_name': 'volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.132426 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf46e4a-d896-4db5-a9be-cdc19afb83ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.137044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf46e4a-d896-4db5-a9be-cdc19afb83ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.144877 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26c53f-8090-43b6-907d-333346211e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.146010 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Volume 55b43f1d-6804-42cd-977d-7eb3aa8d0f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d', 'volume_size': 1} Mar 26 21:17:36.146364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] creating volume 'volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:36.147087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:36.220246 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:36.220616 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:36.224325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26c53f-8090-43b6-907d-333346211e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.228951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4e1f58-78c0-4825-a42e-b75f8a385b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:36.239434 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d (55b43f1d-6804-42cd-977d-7eb3aa8d0f6d): created successfully Mar 26 21:17:36.243213 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4e1f58-78c0-4825-a42e-b75f8a385b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:36.249576 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Flow 'volume_create_manager' (0d09d4d8-5eb3-4d3c-9802-c9720d545cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:36.259051 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-08ef3178-868d-4f8c-8d45-fdd5ac9bcc1b tempest-VolumesListAdminTestJSON-159480450 None] Created volume successfully. Mar 26 21:17:37.669337 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:37.690371 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Flow 'volume_create_manager' (a7bb46ce-5ea2-472a-b75c-e58d920a685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:37.696834 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b89015d-84b5-4187-bc39-c9d124431e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.712019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b89015d-84b5-4187-bc39-c9d124431e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe199e09-99db-4d13-a281-10deb38db717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750263ec3a0f4b24abe0971caa2875d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:38Z,use_quota=True,user_id='871ae14dacdb49658326931151374e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.717577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe3af0-89c3-4ea6-b871-0a977f86af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.722127 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe3af0-89c3-4ea6-b871-0a977f86af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.727020 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e65d6-2637-4361-befd-22163b382cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.731980 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2e65d6-2637-4361-befd-22163b382cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe199e09-99db-4d13-a281-10deb38db717', 'volume_name': 'volume-fe199e09-99db-4d13-a281-10deb38db717', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.736669 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d98fd48-0245-40e0-a46c-b4d41154cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.740604 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d98fd48-0245-40e0-a46c-b4d41154cada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.745358 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf4c86b-a5d2-4fbe-b1fb-080acca834a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.746982 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Volume fe199e09-99db-4d13-a281-10deb38db717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe199e09-99db-4d13-a281-10deb38db717', 'volume_size': 1} Mar 26 21:17:37.747376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] creating volume 'volume-fe199e09-99db-4d13-a281-10deb38db717' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:37.748189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:37.814469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:37.818121 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:37.822521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf4c86b-a5d2-4fbe-b1fb-080acca834a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe199e09-99db-4d13-a281-10deb38db717', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.827258 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8cda47-ac25-4de7-b209-34d3f6638c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:37.836039 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Volume volume-fe199e09-99db-4d13-a281-10deb38db717 (fe199e09-99db-4d13-a281-10deb38db717): created successfully Mar 26 21:17:37.839709 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8cda47-ac25-4de7-b209-34d3f6638c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:37.845343 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Flow 'volume_create_manager' (a7bb46ce-5ea2-472a-b75c-e58d920a685d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:37.852902 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1fbb8b64-a321-4d95-8987-f189592073f7 tempest-VolumesListAdminTestJSON-1116660927 None] Created volume successfully. Mar 26 21:17:38.764423 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Lock "b'cinder-fe199e09-99db-4d13-a281-10deb38db717-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:38.790901 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:38.840695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:38.841125 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Volume volume-fe199e09-99db-4d13-a281-10deb38db717 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:38.849618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] deleting rbd volume volume-fe199e09-99db-4d13-a281-10deb38db717 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:38.867737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:38.905806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:38.954904 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:38.955649 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:38.961997 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] deleting rbd volume volume-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:39.145580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Created reservations ['a1ad005f-e1e6-45ff-b30a-06bb1f060290', '3b71f9c7-7602-4097-a6d8-b5586e5aa33f', '4c58b85e-15fe-48df-9fa9-400f17a59a6e', 'a3ba4895-2b60-42cc-afbd-72c00fed4ed9'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:39.199427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:39.225467 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:39.251033 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:39.264955 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Deleted volume successfully. Mar 26 21:17:39.281400 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-dabc3557-662e-4504-929a-f9bf0308e41b tempest-VolumesListAdminTestJSON-1116660927 None] Lock "b'cinder-fe199e09-99db-4d13-a281-10deb38db717-delete_volume'" released by "delete_volume" :: held 0.517s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:39.301466 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Created reservations ['f34c9f6e-510b-455e-8b38-602fa7748ac2', '92b2fb29-d8cd-401a-9caa-49fd2738113e', 'aa91a591-40f6-444d-a75b-39414bef89d5', '14a77508-7556-4742-a28c-dcaf4a6bc26a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:39.345772 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:39.374260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:39.401353 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:39.405712 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Deleted volume successfully. Mar 26 21:17:39.420366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-0cd36ce5-86ac-49c9-a0f4-02ae4ce0e593 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-55b43f1d-6804-42cd-977d-7eb3aa8d0f6d-delete_volume'" released by "delete_volume" :: held 0.553s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:39.957560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-61e3eed4-d127-463b-ae16-55efa79ca94f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:39.994126 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:40.044384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:40.044743 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-61e3eed4-d127-463b-ae16-55efa79ca94f is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:40.052202 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] deleting rbd volume volume-61e3eed4-d127-463b-ae16-55efa79ca94f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:40.276454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Created reservations ['331e2231-e86f-4cc5-9dea-9475ea580b0f', '83748c3c-c234-41e5-8e94-f2772a1396d8', 'd023a28e-d77a-4b94-90fe-4d4cc5fbcabc', '56df02c0-a9da-4cbb-902f-7b9bb43a6d5f'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:40.319087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:40.347026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:40.375150 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:40.379255 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Deleted volume successfully. Mar 26 21:17:40.394598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-7c4fc369-3e16-4c46-ad9b-38d5c18472c3 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-61e3eed4-d127-463b-ae16-55efa79ca94f-delete_volume'" released by "delete_volume" :: held 0.439s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:41.103551 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-d8c266ef-0d89-4aea-a9ad-76b2c0b48705-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:41.143325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:41.195021 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:41.195448 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Volume volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:41.201759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] deleting rbd volume volume-d8c266ef-0d89-4aea-a9ad-76b2c0b48705 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:41.447310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Created reservations ['213b5432-41a9-455a-9623-e75a1eedf379', '76558214-def5-4798-ac4f-1ec6b69553e5', 'e0d39afb-deb0-4170-9e82-8323895df154', '75dcc7cc-a698-4832-8820-da31b72d7206'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:41.496174 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:41.522279 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:41.554400 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:41.559861 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Deleted volume successfully. Mar 26 21:17:41.583771 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9ec0ba24-cea2-44a2-b410-4767e4ed6f03 tempest-VolumesListAdminTestJSON-159480450 None] Lock "b'cinder-d8c266ef-0d89-4aea-a9ad-76b2c0b48705-delete_volume'" released by "delete_volume" :: held 0.480s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:46.545646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:46.565887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Flow 'volume_create_manager' (189b00ed-a2f2-45c8-906d-046983201ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:46.572663 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aac9077-4abb-455d-a214-7ef5996d59e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.588089 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aac9077-4abb-455d-a214-7ef5996d59e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1514129564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=09dec674-8e89-4387-9d39-fef13577018e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8ba0bfc1324e3291c1766562f379e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:47Z,use_quota=True,user_id='e9cccd717d874ea294cf1b606a1e6adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.593995 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a97d763-1a02-4924-9155-47d4ebd956e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.598275 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a97d763-1a02-4924-9155-47d4ebd956e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.603450 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74e8aca-0258-4fcb-973b-e48cbbc88636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.608034 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74e8aca-0258-4fcb-973b-e48cbbc88636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09dec674-8e89-4387-9d39-fef13577018e', 'volume_name': 'volume-09dec674-8e89-4387-9d39-fef13577018e', 'volume_size': 2}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.612977 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96557f3-082c-4467-9693-189b446d7420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.616871 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96557f3-082c-4467-9693-189b446d7420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.622213 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae70c4a-2e9e-4701-b5c7-ccee2762d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.623289 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Volume 09dec674-8e89-4387-9d39-fef13577018e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09dec674-8e89-4387-9d39-fef13577018e', 'volume_size': 2} Mar 26 21:17:46.623673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] creating volume 'volume-09dec674-8e89-4387-9d39-fef13577018e' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:46.624479 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:46.675324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:46.676313 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:46.680116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae70c4a-2e9e-4701-b5c7-ccee2762d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09dec674-8e89-4387-9d39-fef13577018e', 'volume_size': 2}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.685427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4131c7-6458-4acf-bfc3-8d8bd6abd160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:46.694240 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Volume volume-09dec674-8e89-4387-9d39-fef13577018e (09dec674-8e89-4387-9d39-fef13577018e): created successfully Mar 26 21:17:46.698238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4131c7-6458-4acf-bfc3-8d8bd6abd160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:46.704024 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Flow 'volume_create_manager' (189b00ed-a2f2-45c8-906d-046983201ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:46.713024 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dbc470d9-f1cd-433d-b26d-9281ee1bc0b5 tempest-VolumesCloneNegativeTest-635666049 None] Created volume successfully. Mar 26 21:17:47.632523 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-15c58a22-d887-49d5-bdd8-d7febaa5569c tempest-GroupsV320Test-1111401380 None] Group tempest-GroupsV320Test-Group-736111271: creating Mar 26 21:17:47.648827 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-15c58a22-d887-49d5-bdd8-d7febaa5569c tempest-GroupsV320Test-1111401380 None] Group tempest-GroupsV320Test-Group-736111271: created successfully Mar 26 21:17:47.657180 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-15c58a22-d887-49d5-bdd8-d7febaa5569c tempest-GroupsV320Test-1111401380 None] Create group completed successfully. Mar 26 21:17:47.685487 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Lock "b'cinder-09dec674-8e89-4387-9d39-fef13577018e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:17:47.715472 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:47.751110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:17:47.751530 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Volume volume-09dec674-8e89-4387-9d39-fef13577018e is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:17:47.756044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] deleting rbd volume volume-09dec674-8e89-4387-9d39-fef13577018e {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:17:47.942388 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Created reservations ['22f450cd-6faa-4c2d-92fa-89d6ab74da51', 'd077dc75-8dbc-4dba-8580-8e36d5b408fe', 'f5e21e81-9304-4369-bbd4-27543677f41b', '464a7a55-2e1e-41ca-8035-0914df398006'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:47.986506 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:48.010608 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:48.039701 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:48.044702 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Deleted volume successfully. Mar 26 21:17:48.058260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-27941977-172e-45cc-81c5-67e17e90b5b0 tempest-VolumesCloneNegativeTest-635666049 None] Lock "b'cinder-09dec674-8e89-4387-9d39-fef13577018e-delete_volume'" released by "delete_volume" :: held 0.373s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:17:49.069006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-fc7ea59e-5bc6-4337-b30d-8c0cec23e94d tempest-GroupsV320Test-1111401380 None] Created reservations ['b2f1061c-f1fe-4d91-8602-7128858e190a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:17:49.105733 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fc7ea59e-5bc6-4337-b30d-8c0cec23e94d tempest-GroupsV320Test-1111401380 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:49.130474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fc7ea59e-5bc6-4337-b30d-8c0cec23e94d tempest-GroupsV320Test-1111401380 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:49.155403 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-fc7ea59e-5bc6-4337-b30d-8c0cec23e94d tempest-GroupsV320Test-1111401380 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:49.160364 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fc7ea59e-5bc6-4337-b30d-8c0cec23e94d tempest-GroupsV320Test-1111401380 None] Delete group completed successfully. Mar 26 21:17:58.286969 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:17:58.287576 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:58.313478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:58.337354 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:17:59.436438 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:17:59.455623 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Flow 'volume_create_manager' (b5909385-6cab-49db-b200-62ada01f5609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:59.462605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7514b4d2-dc57-43b0-9997-bbda15c51723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.478031 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7514b4d2-dc57-43b0-9997-bbda15c51723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-933056098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b826a398-4dfb-4b0c-892f-102666deb5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='141efad2a96843f4862051948ec5934b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:17:59Z,use_quota=True,user_id='0be9fff48c24443dbfe8c67b9deb3a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.483532 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ec4956-3777-487a-bb81-6fbe8684809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.487990 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ec4956-3777-487a-bb81-6fbe8684809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.493217 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6453a8-5569-403e-9006-c92911a0a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.497454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6453a8-5569-403e-9006-c92911a0a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b826a398-4dfb-4b0c-892f-102666deb5be', 'volume_name': 'volume-b826a398-4dfb-4b0c-892f-102666deb5be', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.502468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a7f21c-f1ae-4f3f-8eb8-2be0caab675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.506464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a7f21c-f1ae-4f3f-8eb8-2be0caab675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.511795 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5477ce8-6ed3-477e-9a37-a2c52fe4fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.512886 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Volume b826a398-4dfb-4b0c-892f-102666deb5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b826a398-4dfb-4b0c-892f-102666deb5be', 'volume_size': 1} Mar 26 21:17:59.513280 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] creating volume 'volume-b826a398-4dfb-4b0c-892f-102666deb5be' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:17:59.514050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:17:59.561730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:17:59.562040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:17:59.565854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5477ce8-6ed3-477e-9a37-a2c52fe4fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b826a398-4dfb-4b0c-892f-102666deb5be', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.570559 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c286d0-1f81-4b25-a97b-4a7709a12685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:17:59.580065 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Volume volume-b826a398-4dfb-4b0c-892f-102666deb5be (b826a398-4dfb-4b0c-892f-102666deb5be): created successfully Mar 26 21:17:59.583676 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c286d0-1f81-4b25-a97b-4a7709a12685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:17:59.589961 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Flow 'volume_create_manager' (b5909385-6cab-49db-b200-62ada01f5609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:17:59.596929 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-61c1d594-b875-4daa-9b9a-d8496c8a0531 tempest-VolumesServicesTestJSON-1713431456 None] Created volume successfully. Mar 26 21:18:00.584410 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Lock "b'cinder-b826a398-4dfb-4b0c-892f-102666deb5be-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:00.620332 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:00.656754 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:00.657206 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Volume volume-b826a398-4dfb-4b0c-892f-102666deb5be is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:00.662589 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] deleting rbd volume volume-b826a398-4dfb-4b0c-892f-102666deb5be {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:00.855851 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Created reservations ['af5f1746-55f9-464e-99c4-ef17645eee50', '78109652-44f5-40d9-aca7-79d67ee442f9', 'b273247d-54fa-47ee-8945-7c2c8a663884', 'f7f2411b-4d09-4ebb-83b3-b14c32407640'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:00.896094 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:00.917702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:00.939300 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:00.943181 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Deleted volume successfully. Mar 26 21:18:00.954706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-67dba1cd-28b8-46d6-9ad9-ea90d94c2d9d tempest-VolumesServicesTestJSON-1713431456 None] Lock "b'cinder-b826a398-4dfb-4b0c-892f-102666deb5be-delete_volume'" released by "delete_volume" :: held 0.370s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:19.816504 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:19.835355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (1a014f58-5a6b-4920-a8e7-ab88ae7c12db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:19.842044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f4138-bb3c-4577-818b-93b55a25eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.857285 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88f4138-bb3c-4577-818b-93b55a25eedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466830774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=646abde8-89f1-4f26-a9d7-377ce91fe93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:20Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.862723 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5601df9c-7fe9-4090-8187-f34ab5c92016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.866896 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5601df9c-7fe9-4090-8187-f34ab5c92016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.872707 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9583afc-2d4f-4f93-9168-6a32f090ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.876811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9583afc-2d4f-4f93-9168-6a32f090ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646abde8-89f1-4f26-a9d7-377ce91fe93c', 'volume_name': 'volume-646abde8-89f1-4f26-a9d7-377ce91fe93c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.881831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33538c79-5edc-4888-b146-756203658cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.885831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33538c79-5edc-4888-b146-756203658cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.890993 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd0cff0-ff65-48c2-86c3-dc20724420a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.892039 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Volume 646abde8-89f1-4f26-a9d7-377ce91fe93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646abde8-89f1-4f26-a9d7-377ce91fe93c', 'volume_size': 1} Mar 26 21:18:19.892431 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-646abde8-89f1-4f26-a9d7-377ce91fe93c' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:19.893194 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:19.943616 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:19.944137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:19.947947 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd0cff0-ff65-48c2-86c3-dc20724420a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646abde8-89f1-4f26-a9d7-377ce91fe93c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.952715 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fbaa40-d492-4734-bec4-c4768d00baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:19.961493 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Volume volume-646abde8-89f1-4f26-a9d7-377ce91fe93c (646abde8-89f1-4f26-a9d7-377ce91fe93c): created successfully Mar 26 21:18:19.965941 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fbaa40-d492-4734-bec4-c4768d00baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:19.972385 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (1a014f58-5a6b-4920-a8e7-ab88ae7c12db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:19.982923 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-291e69db-9f4d-4b05-9cbf-b77bc18c9db5 tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:20.885719 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-af785e6b-7fab-416a-9136-2dbc9f8f5a95 tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c'" acquired by "attach_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:20.921568 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-af785e6b-7fab-416a-9136-2dbc9f8f5a95 tempest-VolumesActionsTest-1501534813 None] Attaching volume 646abde8-89f1-4f26-a9d7-377ce91fe93c to instance 46f2b437-3aff-46f0-9885-e250bdc7aaef at mountpoint /dev/sdb on host None. Mar 26 21:18:20.943693 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-af785e6b-7fab-416a-9136-2dbc9f8f5a95 tempest-VolumesActionsTest-1501534813 None] Attach volume completed successfully. Mar 26 21:18:20.948629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-af785e6b-7fab-416a-9136-2dbc9f8f5a95 tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c'" released by "attach_volume" :: held 0.064s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:21.317399 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d13e1da8-4d54-43c6-9856-83bcf2bf2163 tempest-VolumesActionsTest-1771588401 None] Terminate volume connection completed successfully. Mar 26 21:18:21.348025 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d13e1da8-4d54-43c6-9856-83bcf2bf2163 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:21.358222 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d13e1da8-4d54-43c6-9856-83bcf2bf2163 tempest-VolumesActionsTest-1771588401 None] Detaching volume 646abde8-89f1-4f26-a9d7-377ce91fe93c from instance 46f2b437-3aff-46f0-9885-e250bdc7aaef. Mar 26 21:18:21.384983 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d13e1da8-4d54-43c6-9856-83bcf2bf2163 tempest-VolumesActionsTest-1771588401 None] Detach volume completed successfully. Mar 26 21:18:21.389926 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d13e1da8-4d54-43c6-9856-83bcf2bf2163 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-detach_volume'" released by "detach_volume" :: held 0.042s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:21.530360 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-60dee08a-61e9-4721-8c2d-800f6a55c8b8 tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:21.530772 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-60dee08a-61e9-4721-8c2d-800f6a55c8b8 tempest-VolumesActionsTest-1501534813 None] Volume detach called, but volume not attached. Mar 26 21:18:21.544150 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-60dee08a-61e9-4721-8c2d-800f6a55c8b8 tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-detach_volume'" released by "detach_volume" :: held 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:25.512440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:25.531355 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (d46ef590-ae25-4f3b-9961-c7e5e75479b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:25.538137 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5159c3-cbfc-4b50-95c5-8dba520a1615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.552844 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5159c3-cbfc-4b50-95c5-8dba520a1615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1379338020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fb769d7-c549-4270-afd4-7d58fa650d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:25Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.558380 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cdbc90-9328-413c-a777-f8bf0591e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.562543 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cdbc90-9328-413c-a777-f8bf0591e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.567703 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1f6d92-4e38-4584-9887-bfe0ff923e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.571765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1f6d92-4e38-4584-9887-bfe0ff923e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb769d7-c549-4270-afd4-7d58fa650d78', 'volume_name': 'volume-7fb769d7-c549-4270-afd4-7d58fa650d78', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.577521 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce419ee4-e405-4840-a024-e99051ab0a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.581460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce419ee4-e405-4840-a024-e99051ab0a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.586186 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330573ae-1ab3-42cb-aa0c-e68f531a3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.587296 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Volume 7fb769d7-c549-4270-afd4-7d58fa650d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb769d7-c549-4270-afd4-7d58fa650d78', 'volume_size': 1} Mar 26 21:18:25.587683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-7fb769d7-c549-4270-afd4-7d58fa650d78' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:25.588937 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:25.639942 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:25.640364 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:25.644188 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330573ae-1ab3-42cb-aa0c-e68f531a3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb769d7-c549-4270-afd4-7d58fa650d78', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.648882 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82007241-be8c-48c0-926c-84aa8faf56c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:25.658303 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Volume volume-7fb769d7-c549-4270-afd4-7d58fa650d78 (7fb769d7-c549-4270-afd4-7d58fa650d78): created successfully Mar 26 21:18:25.662174 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82007241-be8c-48c0-926c-84aa8faf56c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:25.667832 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (d46ef590-ae25-4f3b-9961-c7e5e75479b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:25.676281 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-0ff689b6-a470-49b2-80b3-25a24b6b9b32 tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:26.681982 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-7fb769d7-c549-4270-afd4-7d58fa650d78-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:26.704846 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:26.747443 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:26.747892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Volume volume-7fb769d7-c549-4270-afd4-7d58fa650d78 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:26.755632 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] deleting rbd volume volume-7fb769d7-c549-4270-afd4-7d58fa650d78 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:26.961515 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Created reservations ['1bbcfa95-9312-4abb-bfcb-8189a6ff8917', 'ab7ff933-0001-43e4-8e74-e21b58906bd9', 'd5d4eb6e-c5e8-47de-bf05-966492c83e02', 'd2237d85-bddb-4a4c-9f58-50a0060b14fc'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:27.001401 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:27.024583 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:27.055214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:27.059216 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Deleted volume successfully. Mar 26 21:18:27.070442 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c9ed50bd-61d2-4723-a30c-4ba8c3e144cb tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-7fb769d7-c549-4270-afd4-7d58fa650d78-delete_volume'" released by "delete_volume" :: held 0.388s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:28.068659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:28.088255 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (acf3c5e6-b765-493b-8184-d2a8557fb243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:28.095665 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54e9146-5113-4950-a340-e03682985e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.113432 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54e9146-5113-4950-a340-e03682985e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1930834201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bfeb98f4-f438-4529-92c3-eac65a74a41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:28Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.118938 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b87a05d-39fa-41b3-8c53-fd877db266b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.124127 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b87a05d-39fa-41b3-8c53-fd877db266b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.129304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476420c-dbdc-4e8d-8369-2a6634b1ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.133437 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476420c-dbdc-4e8d-8369-2a6634b1ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfeb98f4-f438-4529-92c3-eac65a74a41c', 'volume_name': 'volume-bfeb98f4-f438-4529-92c3-eac65a74a41c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.138695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af92e8fb-6ec4-4bac-b761-dba33b514ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.142702 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af92e8fb-6ec4-4bac-b761-dba33b514ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.147502 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bea27b-d72b-42d8-9954-07ed0585bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.148794 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Volume bfeb98f4-f438-4529-92c3-eac65a74a41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfeb98f4-f438-4529-92c3-eac65a74a41c', 'volume_size': 1} Mar 26 21:18:28.149210 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-bfeb98f4-f438-4529-92c3-eac65a74a41c' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:28.150100 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:28.236116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:28.236617 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:28.240724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bea27b-d72b-42d8-9954-07ed0585bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfeb98f4-f438-4529-92c3-eac65a74a41c', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.249633 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e4cf2f-4ab3-4679-91a0-bcca21ae3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:28.258078 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Volume volume-bfeb98f4-f438-4529-92c3-eac65a74a41c (bfeb98f4-f438-4529-92c3-eac65a74a41c): created successfully Mar 26 21:18:28.261696 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e4cf2f-4ab3-4679-91a0-bcca21ae3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:28.267338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (acf3c5e6-b765-493b-8184-d2a8557fb243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:28.275174 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-53ee7f05-0074-46cd-bfe3-5beb694604a6 tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:29.231637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-bfeb98f4-f438-4529-92c3-eac65a74a41c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:29.257396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:29.295629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:29.296097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Volume volume-bfeb98f4-f438-4529-92c3-eac65a74a41c is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:29.301416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] deleting rbd volume volume-bfeb98f4-f438-4529-92c3-eac65a74a41c {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:29.512854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Created reservations ['c48c5caa-48ab-4e45-be1e-34194d0f3d87', '3fab5d24-c75e-4d29-8cc6-772dc241ddea', 'f1aedf13-b856-447e-a326-3251f69e1d76', '073f1331-94bf-4616-9979-328669cf4fd4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:29.564004 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:29.598238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:29.640535 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:29.646401 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Deleted volume successfully. Mar 26 21:18:29.660578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c3ef6a52-6dcd-41e2-8e93-31fc9968cf3f tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-bfeb98f4-f438-4529-92c3-eac65a74a41c-delete_volume'" released by "delete_volume" :: held 0.429s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:30.623866 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:30.645306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (c7d13eae-61af-478c-b847-d44dc21ce88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:30.653780 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363868b4-1a6c-40ed-aec9-ab9ea077b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.672655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363868b4-1a6c-40ed-aec9-ab9ea077b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-659906919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92603207-b550-4985-85f3-30543a4935c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:31Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.678944 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18437f71-5538-425d-b781-61c91c133078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.684058 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18437f71-5538-425d-b781-61c91c133078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.689726 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9410795f-694a-4e59-ad58-798ee778e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.694181 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9410795f-694a-4e59-ad58-798ee778e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92603207-b550-4985-85f3-30543a4935c8', 'volume_name': 'volume-92603207-b550-4985-85f3-30543a4935c8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.699668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa978336-5598-4fee-8976-b569756b89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.703892 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa978336-5598-4fee-8976-b569756b89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.709126 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b05b30-e99d-4022-9a74-c0510026c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.710672 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Volume 92603207-b550-4985-85f3-30543a4935c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92603207-b550-4985-85f3-30543a4935c8', 'volume_size': 1} Mar 26 21:18:30.711315 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-92603207-b550-4985-85f3-30543a4935c8' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:30.712253 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:30.818242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:30.818242 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:30.822620 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b05b30-e99d-4022-9a74-c0510026c558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92603207-b550-4985-85f3-30543a4935c8', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.831434 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a061773-0f24-44af-86d8-7c76a1a72ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:30.842638 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Volume volume-92603207-b550-4985-85f3-30543a4935c8 (92603207-b550-4985-85f3-30543a4935c8): created successfully Mar 26 21:18:30.847399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a061773-0f24-44af-86d8-7c76a1a72ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:30.853937 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (c7d13eae-61af-478c-b847-d44dc21ce88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:30.865395 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fb0d5bd7-e742-408b-9c56-679c6a6f4522 tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:31.803027 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-92603207-b550-4985-85f3-30543a4935c8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:31.837549 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:31.894362 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:31.896383 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Volume volume-92603207-b550-4985-85f3-30543a4935c8 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:31.901178 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] deleting rbd volume volume-92603207-b550-4985-85f3-30543a4935c8 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:32.151858 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Created reservations ['a98e76b0-a17c-406f-88bd-9b7c27a4292d', 'ec850b04-6b1b-4909-9038-339f9e3cf0b9', '4ddeb434-e1aa-48da-8e15-35eb55ed815a', 'f6443f77-aef1-4782-acce-d021035291bb'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:32.192776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:32.227110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:32.269314 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:32.279388 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Deleted volume successfully. Mar 26 21:18:32.290356 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-5dad4045-bf66-41a3-9d86-b6337e79def5 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-92603207-b550-4985-85f3-30543a4935c8-delete_volume'" released by "delete_volume" :: held 0.487s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:33.242416 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:33.261562 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (dc78ef6e-b23d-4a24-8da2-8ce173f707e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:33.268486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1e5ba9-bd7c-4c67-ae49-1ada6f745be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.283117 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1e5ba9-bd7c-4c67-ae49-1ada6f745be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088701734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d343b14a-5486-462f-916e-4b625e6750d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:33Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.288580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6f0ae2-4543-424d-8d84-eab23fa68689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.293373 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6f0ae2-4543-424d-8d84-eab23fa68689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.298523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86504dd2-5e11-44ae-ab8d-9f055c5c2af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.302853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86504dd2-5e11-44ae-ab8d-9f055c5c2af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd343b14a-5486-462f-916e-4b625e6750d7', 'volume_name': 'volume-d343b14a-5486-462f-916e-4b625e6750d7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.308449 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5915ed1d-66d1-4d30-b55c-e74e14dfdb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.312376 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5915ed1d-66d1-4d30-b55c-e74e14dfdb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.317140 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e80375c-461c-4f21-a89a-f02ff3ed1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.318251 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Volume d343b14a-5486-462f-916e-4b625e6750d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d343b14a-5486-462f-916e-4b625e6750d7', 'volume_size': 1} Mar 26 21:18:33.318637 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-d343b14a-5486-462f-916e-4b625e6750d7' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:33.319406 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:33.371260 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:33.371657 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:33.375427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e80375c-461c-4f21-a89a-f02ff3ed1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d343b14a-5486-462f-916e-4b625e6750d7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.380231 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c399a55-3510-448c-bfe4-ccf4942b8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:33.388707 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Volume volume-d343b14a-5486-462f-916e-4b625e6750d7 (d343b14a-5486-462f-916e-4b625e6750d7): created successfully Mar 26 21:18:33.392283 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c399a55-3510-448c-bfe4-ccf4942b8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:33.398488 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (dc78ef6e-b23d-4a24-8da2-8ce173f707e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:33.406976 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-74c67c38-198f-40e6-959d-0dad6225658f tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:34.396049 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-d343b14a-5486-462f-916e-4b625e6750d7-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:34.423337 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:34.460910 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:34.461431 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Volume volume-d343b14a-5486-462f-916e-4b625e6750d7 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:34.468170 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] deleting rbd volume volume-d343b14a-5486-462f-916e-4b625e6750d7 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:34.686794 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Created reservations ['4a3d0797-a94b-410c-a45e-e299c1c1757e', '424f64ea-de15-4425-a2b8-9a64e30c50ba', '60022da5-829c-4400-b659-c79c14b856fa', '8a3592f7-c8b9-402b-9069-3fd07b852ddf'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:34.726784 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:34.751292 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:34.775860 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:34.780981 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Deleted volume successfully. Mar 26 21:18:34.792949 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-b38a3f0a-944f-4146-b0a6-8298fa4f51f3 tempest-VolumesActionsTest-1771588401 None] Lock "b'cinder-d343b14a-5486-462f-916e-4b625e6750d7-delete_volume'" released by "delete_volume" :: held 0.397s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:35.819836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:18:35.839136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (d9f27db5-1b3e-4dfa-b1d2-8976ccc5e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:35.845776 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69330b1a-b1e7-45cb-975f-20c0342cc3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.866218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69330b1a-b1e7-45cb-975f-20c0342cc3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2070545836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3ee9d1e7b94fc4a74f972e70c05257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:18:36Z,use_quota=True,user_id='92be875a64494d6dae76ee0c088c84c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.872038 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393c900e-258f-43f6-88b6-031de95a1d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.876874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393c900e-258f-43f6-88b6-031de95a1d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.882828 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65596cfb-e1f0-4dcc-b6ed-cd409e25ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.887285 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65596cfb-e1f0-4dcc-b6ed-cd409e25ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a', 'volume_name': 'volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.892316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dde9931-cc28-4811-903a-6746305aa275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.896297 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dde9931-cc28-4811-903a-6746305aa275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.901598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08e487f-2d93-4923-8838-45252360a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.902695 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Volume 821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a', 'volume_size': 1} Mar 26 21:18:35.903091 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] creating volume 'volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:18:35.903860 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:35.965903 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:18:35.966666 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:18:35.971131 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08e487f-2d93-4923-8838-45252360a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.976480 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea7ed54-d590-4a1c-9656-08e29d5b8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:18:35.988371 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Volume volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a (821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a): created successfully Mar 26 21:18:35.992072 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea7ed54-d590-4a1c-9656-08e29d5b8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:18:35.997969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Flow 'volume_create_manager' (d9f27db5-1b3e-4dfa-b1d2-8976ccc5e13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:18:36.016252 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-1ccb30d4-2983-42ca-b6fd-52c2eaa46f23 tempest-VolumesActionsTest-1501534813 None] Created volume successfully. Mar 26 21:18:37.475298 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:37.539648 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:37.607836 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:37.608395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Volume volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:37.616392 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] deleting rbd volume volume-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:37.884189 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Created reservations ['5aafc885-d217-46a2-b754-63df0756f7a2', '8d88bea6-f7df-4dd2-bf82-a4250c4e871e', 'dbf8b01b-e373-4ec2-9a78-110d00e3b102', '8c66e2dc-8a07-4669-bcac-0784323ce0cc'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:37.941914 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:37.991067 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:38.045865 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:38.051619 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Deleted volume successfully. Mar 26 21:18:38.078214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9284bfbd-0767-46e7-876a-6dad9fe9e0aa tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-821fd663-fc1e-4c0d-8e1f-fc6a7a708a9a-delete_volume'" released by "delete_volume" :: held 0.603s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:38.762738 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:18:38.822661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:38.912049 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:18:38.912973 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Volume volume-646abde8-89f1-4f26-a9d7-377ce91fe93c is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:18:38.924050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] deleting rbd volume volume-646abde8-89f1-4f26-a9d7-377ce91fe93c {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:18:39.379612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Created reservations ['b99ecf5f-e0b6-405c-bc23-fea5d4b11398', 'a7c8e781-2395-49db-9dc9-3a6434187ac2', 'abd46c6f-f399-4903-9ca2-8f7ab13ae223', '70604ffe-032e-483a-8bce-0af3870f02d4'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:18:39.439266 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:39.471607 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:39.523375 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:18:39.530396 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Deleted volume successfully. Mar 26 21:18:39.549072 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-cad3e698-8504-4635-8805-f7e55b64684a tempest-VolumesActionsTest-1501534813 None] Lock "b'cinder-646abde8-89f1-4f26-a9d7-377ce91fe93c-delete_volume'" released by "delete_volume" :: held 0.786s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:18:58.283082 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:18:58.283793 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:58.308772 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:18:58.335579 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:19:58.280932 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:19:58.282406 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:19:58.310113 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:19:58.340271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:20:52.503893 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:20:52.535155 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (3fdfe6cd-4c5b-403a-a74b-b4f8159aa12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:20:52.550679 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d490e4-c7f6-4b46-92f0-7fe8d300e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:52.584220 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d490e4-c7f6-4b46-92f0-7fe8d300e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-114899081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cce9f796-4510-4fca-bd6a-0074ffb1d821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:20:52Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:52.590129 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72322ca-5ca3-4a6c-981e-178a8c0289bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:52.594673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72322ca-5ca3-4a6c-981e-178a8c0289bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:52.600464 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558d389f-d6b9-4670-aad5-3665e3344a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:52.745504 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558d389f-d6b9-4670-aad5-3665e3344a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cce9f796-4510-4fca-bd6a-0074ffb1d821', 'volume_name': 'volume-cce9f796-4510-4fca-bd6a-0074ffb1d821', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:52.757580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e63105-3244-4bc7-aed0-69a966364e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:52.769625 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e63105-3244-4bc7-aed0-69a966364e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:52.784833 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5833f35-ead5-42db-9f43-970c70ed5a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:52.788661 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Volume cce9f796-4510-4fca-bd6a-0074ffb1d821: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cce9f796-4510-4fca-bd6a-0074ffb1d821', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:20:52.790578 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Cloning cce9f796-4510-4fca-bd6a-0074ffb1d821 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:20:52.814312 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:20:52.833267 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 20, 52, 822838)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:20:52.834324 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:20:52.835950 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:20:52.844207 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:20:52.846930 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:20:52.862340 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 20, 52, 858550)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:20:52.865778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:20:52.868229 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:20:52.894610 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:53.065443 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] creating snapshot='volume-cce9f796-4510-4fca-bd6a-0074ffb1d821.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:20:53.310594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-cce9f796-4510-4fca-bd6a-0074ffb1d821.clone_snap' to 'volume-cce9f796-4510-4fca-bd6a-0074ffb1d821' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:20:53.550297 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:20:53.553433 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:20:53.554005 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:20:53.583706 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:20:53.584633 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Marking volume cce9f796-4510-4fca-bd6a-0074ffb1d821 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:20:53.595773 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to cce9f796-4510-4fca-bd6a-0074ffb1d821. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:20:53.596097 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Creating volume glance metadata for volume cce9f796-4510-4fca-bd6a-0074ffb1d821 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:20:53.681819 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5833f35-ead5-42db-9f43-970c70ed5a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce9f796-4510-4fca-bd6a-0074ffb1d821', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:53.690835 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a49457-eeb8-474d-b940-82f9e1f42437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:53.702102 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Volume volume-cce9f796-4510-4fca-bd6a-0074ffb1d821 (cce9f796-4510-4fca-bd6a-0074ffb1d821): created successfully Mar 26 21:20:53.708191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a49457-eeb8-474d-b940-82f9e1f42437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:53.717110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (3fdfe6cd-4c5b-403a-a74b-b4f8159aa12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:20:53.728381 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-8ab86a8d-3f7d-4ce8-a213-f7e511d5f9a2 tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:20:54.850507 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-286e434c-6110-4af7-9e3e-3771660c5734 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:55.370684 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-286e434c-6110-4af7-9e3e-3771660c5734 tempest-TestVolumeBootPattern-540060077 None] Create snapshot completed successfully Mar 26 21:20:58.263507 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:20:58.293205 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (715d2da1-fe78-4685-8170-469512fe63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:20:58.300445 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303b174d-2fd3-49fd-ba77-e89cb7b99149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:58.303346 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:20:58.304000 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:58.347273 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:58.419831 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:20:58.450114 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303b174d-2fd3-49fd-ba77-e89cb7b99149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:20:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97e236f2-b607-4957-9631-2c5ab141d8d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:20:58Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:58.468863 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d9afc6-94b8-4646-ba10-8ef132abd1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:58.480560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d9afc6-94b8-4646-ba10-8ef132abd1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:58.493602 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98956222-c6df-4863-aad0-4f4f74873563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:58.499849 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98956222-c6df-4863-aad0-4f4f74873563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'volume_name': 'volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'volume_size': 1, 'snapshot_id': '97e236f2-b607-4957-9631-2c5ab141d8d7'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:58.509044 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda92c27-3e9d-4ed3-9cd3-c9f3a2a58ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:58.513920 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda92c27-3e9d-4ed3-9cd3-c9f3a2a58ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:58.520487 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7231e00e-bdd9-45ff-91c4-25a19824a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:58.521867 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Volume ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'volume_size': 1, 'snapshot_id': '97e236f2-b607-4957-9631-2c5ab141d8d7'} Mar 26 21:20:58.549948 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] cloning volumes/volume-cce9f796-4510-4fca-bd6a-0074ffb1d821@snapshot-97e236f2-b607-4957-9631-2c5ab141d8d7 to volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74 {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:20:58.550968 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:58.664966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:20:58.887650 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:20:58.888457 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:20:58.910692 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Marking volume ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:20:58.931747 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Copying metadata from snapshot 97e236f2-b607-4957-9631-2c5ab141d8d7 to ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Mar 26 21:20:58.977742 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7231e00e-bdd9-45ff-91c4-25a19824a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'volume_size': 1, 'snapshot_id': '97e236f2-b607-4957-9631-2c5ab141d8d7'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:58.983386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cadb6bb-8201-4af7-baa8-442c7420c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:20:59.005524 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Volume volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74 (ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74): created successfully Mar 26 21:20:59.010677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cadb6bb-8201-4af7-baa8-442c7420c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:20:59.017715 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (715d2da1-fe78-4685-8170-469512fe63b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:20:59.039419 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-fdcdfbee-8b1e-447c-a337-2b3ebfb1380e tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:21:01.495440 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-bb9d4fff-d658-4dee-a1aa-7f68ac807699 tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:21:02.158796 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-bb9d4fff-d658-4dee-a1aa-7f68ac807699 tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.663s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:21:02.159633 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-bb9d4fff-d658-4dee-a1aa-7f68ac807699 tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:21:02.183633 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-bb9d4fff-d658-4dee-a1aa-7f68ac807699 tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4b97bebd-8b61-4952-a88e-257fb3d0e24f'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:21:02.230368 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-b4cc5ee3-2c86-442e-8339-e30b0e7012af req-bb9d4fff-d658-4dee-a1aa-7f68ac807699 tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:21:12.514566 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-4c9755e1-1f03-4e90-8b75-287dc8735b82 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:21:12.515238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-4c9755e1-1f03-4e90-8b75-287dc8735b82 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment 4b97bebd-8b61-4952-a88e-257fb3d0e24f. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:21:12.634745 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:12.666170 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:12.745250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:21:12.752268 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:21:12.987974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] Created reservations ['5f7f3c1c-42b6-4284-9bbd-ce08e4328190', '32762522-42ec-4c1d-b52d-3373a87d74d9', '72990ceb-edc2-48b5-8d9f-908a65a28abe', '80a0c3a1-ed64-42b0-80bd-8574b78653fb'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:21:13.035613 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:13.064752 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:13.088169 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:21:13.092532 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:21:13.104341 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 req-d99141f4-0eab-4f95-ab74-423d9a6a1ae6 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-ad4aa7fb-09fa-4052-a1a8-bc73dd4e1f74-delete_volume'" released by "delete_volume" :: held 0.470s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:21:14.095557 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-de6e1e33-8572-4ef1-8850-fce2c26e207e tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-97e236f2-b607-4957-9631-2c5ab141d8d7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:14.097250 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-de6e1e33-8572-4ef1-8850-fce2c26e207e tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:15.270970 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-de6e1e33-8572-4ef1-8850-fce2c26e207e tempest-TestVolumeBootPattern-540060077 None] Created reservations ['bbafcd8b-e0c4-4e35-a813-56fc339ba0e2', '624d8e7a-5c20-41d3-9194-80d3778e4c28', '39178e7b-8c26-4774-89b3-3e4a69e4d0c2', '97b91e64-c5fd-4a58-8448-a7d66c3daad5'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:21:15.308068 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-de6e1e33-8572-4ef1-8850-fce2c26e207e tempest-TestVolumeBootPattern-540060077 None] Delete snapshot completed successfully. Mar 26 21:21:15.312759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-de6e1e33-8572-4ef1-8850-fce2c26e207e tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-97e236f2-b607-4957-9631-2c5ab141d8d7-delete_snapshot'" released by "delete_snapshot" :: held 1.217s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:21:16.226117 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-cce9f796-4510-4fca-bd6a-0074ffb1d821-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:16.262911 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:16.318661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:21:16.325560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-cce9f796-4510-4fca-bd6a-0074ffb1d821 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:21:16.483008 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:21:16.514305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] deleting parent snapshot volume-cce9f796-4510-4fca-bd6a-0074ffb1d821.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:21:17.280945 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] Created reservations ['29914967-b1fe-47b1-abbf-ed88650c85ca', '265f43e0-051f-4af3-91fb-e05f60907e6c', 'd08c2d30-41e6-432e-b2a9-1e290f5f5fde', 'f7668e7f-b8f5-4d3a-98e3-0f300ec0f5e9'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:21:17.322952 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:17.344974 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:17.366410 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:21:17.370684 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:21:17.382604 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-fd7e2b4a-ed85-4d64-97f2-ae10ef575b2f tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-cce9f796-4510-4fca-bd6a-0074ffb1d821-delete_volume'" released by "delete_volume" :: held 1.157s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:21:18.762915 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:21:18.783060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (9fbd56d6-fef2-473c-9888-75feef79bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:21:18.790508 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563703cf-409b-44e3-8ebf-36a100dac9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:18.806098 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563703cf-409b-44e3-8ebf-36a100dac9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-55705248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:21:19Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:18.811655 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c90324-d29e-4874-8f88-4f7fb1a8d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:18.815873 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c90324-d29e-4874-8f88-4f7fb1a8d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:18.821220 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16784585-a509-4884-b2fa-09d5bb45c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:18.897472 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16784585-a509-4884-b2fa-09d5bb45c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'volume_name': 'volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:18.903148 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1f385-7176-4447-9787-c9ff15f6c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:18.907162 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1f385-7176-4447-9787-c9ff15f6c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:18.911995 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61698bad-92b5-4b03-81f9-58ac1856e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:18.913131 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Volume 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:21:18.913704 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Cloning 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:21:18.924625 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:18.933997 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 21, 18, 928915)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:21:18.934510 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:21:18.934908 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:21:18.938724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:21:18.939600 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:21:18.944713 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 21, 18, 942634)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:21:18.945123 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:21:18.945535 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:21:18.956213 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:19.007420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] creating snapshot='volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:21:19.247984 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f.clone_snap' to 'volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:21:19.372455 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:21:19.373593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:21:19.373969 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:21:19.390458 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:21:19.391061 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Marking volume 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:21:19.398806 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:21:19.399223 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Creating volume glance metadata for volume 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:21:19.447708 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61698bad-92b5-4b03-81f9-58ac1856e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:19.452488 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e82ac5b-fdb7-4f62-a9a3-5b21af2ea7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:19.460226 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Volume volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f (24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f): created successfully Mar 26 21:21:19.463757 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e82ac5b-fdb7-4f62-a9a3-5b21af2ea7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:19.469425 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (9fbd56d6-fef2-473c-9888-75feef79bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:21:19.476187 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-a182f153-00c8-4936-a086-879c79fe6ee2 tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:21:21.534278 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-4ffde56c-da82-4431-a386-c759f612225c req-1cac656f-c066-4e1b-a7a2-dc801c3adf23 tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:21:22.170537 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-4ffde56c-da82-4431-a386-c759f612225c req-1cac656f-c066-4e1b-a7a2-dc801c3adf23 tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:21:22.171434 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-4ffde56c-da82-4431-a386-c759f612225c req-1cac656f-c066-4e1b-a7a2-dc801c3adf23 tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:21:22.206782 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-4ffde56c-da82-4431-a386-c759f612225c req-1cac656f-c066-4e1b-a7a2-dc801c3adf23 tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a012801c-449f-4247-909f-eaa495eeb3f1'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:21:22.260311 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-4ffde56c-da82-4431-a386-c759f612225c req-1cac656f-c066-4e1b-a7a2-dc801c3adf23 tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:21:30.521340 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-298bd474-d672-44d2-afe7-68ff04b05f0a req-a27c50df-ce36-4f1b-a13c-6edfd1024f7a tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:30.763214 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-298bd474-d672-44d2-afe7-68ff04b05f0a req-a27c50df-ce36-4f1b-a13c-6edfd1024f7a tempest-TestVolumeBootPattern-540060077 None] Create snapshot completed successfully Mar 26 21:21:33.265040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:21:33.295557 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (30f9fdcb-bc14-4f7d-8491-5d57af32c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:21:33.302152 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54deadb-56fb-46fa-ab8e-c07966120a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.317366 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54deadb-56fb-46fa-ab8e-c07966120a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:21:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5ea77ae-fd20-49d0-abbf-03de84a2e7da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:21:33Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.322743 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283493aa-18e0-4630-b39c-e469fc2a3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.327441 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283493aa-18e0-4630-b39c-e469fc2a3782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.332765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f796b37-6feb-49cd-b426-bfb813cfb256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.336942 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f796b37-6feb-49cd-b426-bfb813cfb256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'volume_name': 'volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'volume_size': 1, 'snapshot_id': 'd5ea77ae-fd20-49d0-abbf-03de84a2e7da'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.342374 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f11e16-8ea8-4de2-867d-b79185ce0a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.346313 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f11e16-8ea8-4de2-867d-b79185ce0a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.351264 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cfbce9-d229-4394-bd62-f1ed942bd7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.352546 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Volume fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'volume_size': 1, 'snapshot_id': 'd5ea77ae-fd20-49d0-abbf-03de84a2e7da'} Mar 26 21:21:33.382007 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] cloning volumes/volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f@snapshot-d5ea77ae-fd20-49d0-abbf-03de84a2e7da to volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:21:33.382875 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:33.484115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:33.647257 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:21:33.647645 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:21:33.666142 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Marking volume fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:21:33.674588 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Copying metadata from snapshot d5ea77ae-fd20-49d0-abbf-03de84a2e7da to fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Mar 26 21:21:33.710454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cfbce9-d229-4394-bd62-f1ed942bd7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'volume_size': 1, 'snapshot_id': 'd5ea77ae-fd20-49d0-abbf-03de84a2e7da'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.715229 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70771bab-7551-48a1-86d4-430b0dec093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:21:33.723490 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Volume volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f (fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f): created successfully Mar 26 21:21:33.727102 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70771bab-7551-48a1-86d4-430b0dec093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:21:33.732798 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (30f9fdcb-bc14-4f7d-8491-5d57af32c990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:21:33.744784 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-e9ef680c-7f08-4505-913a-6ba66a7c7cff tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:21:36.531090 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-aa8ac3ab-961c-45e5-a849-e878586c05cc tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:21:37.158671 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-aa8ac3ab-961c-45e5-a849-e878586c05cc tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.627s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:21:37.159499 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-aa8ac3ab-961c-45e5-a849-e878586c05cc tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:21:37.182368 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-aa8ac3ab-961c-45e5-a849-e878586c05cc tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4f631047-c602-415e-aa3a-157ff7246a0e'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:21:37.226808 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 req-aa8ac3ab-961c-45e5-a849-e878586c05cc tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:21:49.017270 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-fb6dd079-e63c-4094-9547-fb24f0a5a814 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:21:49.018374 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-fb6dd079-e63c-4094-9547-fb24f0a5a814 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment 4f631047-c602-415e-aa3a-157ff7246a0e. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:21:49.170310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:49.235143 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:49.314156 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:21:49.320577 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:21:49.517508 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] Created reservations ['989523c1-ff80-4857-bbd9-17541727c988', '8bbe9acb-eef1-4bb7-bfa3-a8c836fd5fd2', 'f0c9cda0-2556-4532-9df4-e45ca1fc6b82', 'f49b4da1-66f8-41b8-aeea-1a714722a8ac'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:21:49.565817 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:49.594651 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:49.634026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:21:49.638522 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:21:49.650765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-d31f6dae-d093-44b3-8798-7136d986ec83 req-3cb9d91d-af76-43b2-a91f-7b163acf1c88 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-fe1bf756-1ceb-47ad-b570-1cc6c49c5f8f-delete_volume'" released by "delete_volume" :: held 0.481s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:21:50.202165 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eedbe89a-08e0-44c4-87e4-b0690b08626b tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-d5ea77ae-fd20-49d0-abbf-03de84a2e7da-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:21:50.204411 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-eedbe89a-08e0-44c4-87e4-b0690b08626b tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:58.301753 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:21:58.302476 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:58.331230 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:21:58.362598 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:22:20.453874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-eedbe89a-08e0-44c4-87e4-b0690b08626b tempest-TestVolumeBootPattern-540060077 None] Created reservations ['79684b59-de86-4390-9e2f-8d4979e7d333', 'ca759e0d-9182-425c-931c-a4a855d5fe26', 'a4c2f474-9d7f-4061-a460-10c2bef39d1e', '5e99289f-3199-49b4-b7d5-fa695a91d480'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:22:20.501209 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-eedbe89a-08e0-44c4-87e4-b0690b08626b tempest-TestVolumeBootPattern-540060077 None] Delete snapshot completed successfully. Mar 26 21:22:20.506179 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-eedbe89a-08e0-44c4-87e4-b0690b08626b tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-d5ea77ae-fd20-49d0-abbf-03de84a2e7da-delete_snapshot'" released by "delete_snapshot" :: held 30.304s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:22:23.472003 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-7164920c-6c2b-4f9a-9542-3356b1830db6 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:22:23.472662 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-7164920c-6c2b-4f9a-9542-3356b1830db6 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment a012801c-449f-4247-909f-eaa495eeb3f1. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:22:23.586185 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:22:23.618827 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:23.691325 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:22:23.698414 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:22:23.980397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:22:24.029252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] deleting parent snapshot volume-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:22:24.922386 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] Created reservations ['66ff95bc-9c0a-4c7f-a06d-fccf1ff97940', 'c2fac111-df74-43c6-9588-37b44da41728', 'ec0de150-e0d9-4daa-b383-b358681e32a0', 'b3a58a96-fe01-49d5-ba87-9010c8673324'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:22:24.964311 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:24.991133 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:25.020673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:22:25.025004 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:22:25.036843 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-d0a66c3a-f737-4fce-ad67-b111f489339e req-19169aa8-c005-490d-8d8e-bfe19a61be2a tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f-delete_volume'" released by "delete_volume" :: held 1.451s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:22:27.820145 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:22:27.842783 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (df02751e-f837-4c9e-862b-e0e30f0b0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:22:27.850255 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa60c51-368a-4094-91d6-cbdaf90ddf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:27.866215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa60c51-368a-4094-91d6-cbdaf90ddf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-438281805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44eb25a7-2179-422f-a764-436f790469c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:22:28Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:27.871765 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f627a589-dbbe-4212-84bb-7d8ea129e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:27.876063 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f627a589-dbbe-4212-84bb-7d8ea129e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:27.881538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd0d629-254e-4085-8520-01761337c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:27.958390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd0d629-254e-4085-8520-01761337c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44eb25a7-2179-422f-a764-436f790469c5', 'volume_name': 'volume-44eb25a7-2179-422f-a764-436f790469c5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:27.963369 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516dbb43-b901-4b71-bc7f-761334265276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:27.967828 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516dbb43-b901-4b71-bc7f-761334265276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:27.973083 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505bb137-ed96-4458-8509-89598c1714bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:27.974223 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Volume 44eb25a7-2179-422f-a764-436f790469c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44eb25a7-2179-422f-a764-436f790469c5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:22:27.974771 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Cloning 44eb25a7-2179-422f-a764-436f790469c5 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:22:27.982922 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:22:27.992420 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 22, 27, 987496)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:22:27.992887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:22:27.993349 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:22:27.997075 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:22:27.997951 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:22:28.003057 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 22, 28, 995)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:22:28.003452 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:22:28.003838 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:22:28.015201 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:28.067005 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] creating snapshot='volume-44eb25a7-2179-422f-a764-436f790469c5.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:22:28.886820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-44eb25a7-2179-422f-a764-436f790469c5.clone_snap' to 'volume-44eb25a7-2179-422f-a764-436f790469c5' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:22:29.017118 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:22:29.018277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:22:29.018653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:22:29.036151 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:22:29.036770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Marking volume 44eb25a7-2179-422f-a764-436f790469c5 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:22:29.045197 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 44eb25a7-2179-422f-a764-436f790469c5. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:22:29.045618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Creating volume glance metadata for volume 44eb25a7-2179-422f-a764-436f790469c5 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:22:29.093760 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505bb137-ed96-4458-8509-89598c1714bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44eb25a7-2179-422f-a764-436f790469c5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:29.098428 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb862d2c-4d36-452a-b32a-48fc8be77030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:22:29.106002 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Volume volume-44eb25a7-2179-422f-a764-436f790469c5 (44eb25a7-2179-422f-a764-436f790469c5): created successfully Mar 26 21:22:29.110094 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb862d2c-4d36-452a-b32a-48fc8be77030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:22:29.115612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (df02751e-f837-4c9e-862b-e0e30f0b0a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:22:29.123302 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d9ced744-bc4f-4e6a-9d09-b53d7a1b8c88 tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:22:31.691176 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-14cfb66c-d955-41c1-b0df-0f2b2694541d req-81a341bb-758d-40ec-ab45-0015e5d09db8 tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:22:32.340048 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-14cfb66c-d955-41c1-b0df-0f2b2694541d req-81a341bb-758d-40ec-ab45-0015e5d09db8 tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.648s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:22:32.340905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-14cfb66c-d955-41c1-b0df-0f2b2694541d req-81a341bb-758d-40ec-ab45-0015e5d09db8 tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44eb25a7-2179-422f-a764-436f790469c5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '44eb25a7-2179-422f-a764-436f790469c5', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:22:32.365989 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-14cfb66c-d955-41c1-b0df-0f2b2694541d req-81a341bb-758d-40ec-ab45-0015e5d09db8 tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-44eb25a7-2179-422f-a764-436f790469c5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '44eb25a7-2179-422f-a764-436f790469c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e01b086-1f3e-4bd3-882c-44dd92482c91'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:22:32.412321 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-14cfb66c-d955-41c1-b0df-0f2b2694541d req-81a341bb-758d-40ec-ab45-0015e5d09db8 tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:22:58.298780 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:22:58.300258 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:58.325594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:22:58.347414 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:23:58.302311 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:23:58.303006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:23:58.326707 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:23:58.355109 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:24:49.650494 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 req-d3f71c94-4ac0-4724-9b94-56cd68784e81 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:24:49.651139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 req-d3f71c94-4ac0-4724-9b94-56cd68784e81 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment 7e01b086-1f3e-4bd3-882c-44dd92482c91. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:24:52.735684 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b6205b43-861a-42cd-88a9-d10f92080276 req-7c59368f-9861-4589-9997-9c029c5b73fc tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:24:53.412829 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-b6205b43-861a-42cd-88a9-d10f92080276 req-7c59368f-9861-4589-9997-9c029c5b73fc tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.677s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:24:53.413555 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-b6205b43-861a-42cd-88a9-d10f92080276 req-7c59368f-9861-4589-9997-9c029c5b73fc tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44eb25a7-2179-422f-a764-436f790469c5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '44eb25a7-2179-422f-a764-436f790469c5', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:24:53.435017 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-b6205b43-861a-42cd-88a9-d10f92080276 req-7c59368f-9861-4589-9997-9c029c5b73fc tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-44eb25a7-2179-422f-a764-436f790469c5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '44eb25a7-2179-422f-a764-436f790469c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '25ebfa4a-ad3f-4066-9eff-74e4dbf41e01'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:24:53.483599 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-b6205b43-861a-42cd-88a9-d10f92080276 req-7c59368f-9861-4589-9997-9c029c5b73fc tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:24:58.301521 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:24:58.303755 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:24:58.350962 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:24:58.389662 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:25:58.305797 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:25:58.306554 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:25:58.341737 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:25:58.381959 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:26:55.475827 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-08607d77-2b4d-4a7f-8e05-45cfdba982b4 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:26:56.013787 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-08607d77-2b4d-4a7f-8e05-45cfdba982b4 tempest-TestVolumeBootPattern-540060077 None] Create snapshot completed successfully Mar 26 21:26:56.925466 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:26:56.956939 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (d0716c36-e81a-461e-9017-2c2919405d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:26:56.964387 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a383382-459a-4732-9943-36cc76f14e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:56.981964 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a383382-459a-4732-9943-36cc76f14e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1786505516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bbb91d4-daf0-4273-8d8b-4c9431888ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c621f87120ad402a9d52cf6426f0cf1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ca0c0b0-442e-4827-b82a-e6a6c1fe545e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:26:57Z,use_quota=True,user_id='39d6d477fac5463a944d918490b7117f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:56.987672 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25064567-438c-4537-a519-6de333e48c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:56.992718 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25064567-438c-4537-a519-6de333e48c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:56.998184 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14245e25-4a69-41a0-9165-750eb01ab485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:57.002668 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14245e25-4a69-41a0-9165-750eb01ab485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'volume_name': 'volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'volume_size': 1, 'snapshot_id': '8ca0c0b0-442e-4827-b82a-e6a6c1fe545e'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:57.010229 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d775f2-6d4a-441b-b01f-2a7b8edd6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:57.014399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d775f2-6d4a-441b-b01f-2a7b8edd6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:57.019394 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e719f10a-1137-493f-bffa-571071bd4666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:57.020580 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Volume 0bbb91d4-daf0-4273-8d8b-4c9431888ae4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'volume_size': 1, 'snapshot_id': '8ca0c0b0-442e-4827-b82a-e6a6c1fe545e'} Mar 26 21:26:57.045824 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] cloning volumes/volume-44eb25a7-2179-422f-a764-436f790469c5@snapshot-8ca0c0b0-442e-4827-b82a-e6a6c1fe545e to volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4 {{(pid=134842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}} Mar 26 21:26:57.046509 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:26:57.119390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:26:57.287424 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:26:57.287813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:26:57.311124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Marking volume 0bbb91d4-daf0-4273-8d8b-4c9431888ae4 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:26:57.315987 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Copying metadata from snapshot 8ca0c0b0-442e-4827-b82a-e6a6c1fe545e to 0bbb91d4-daf0-4273-8d8b-4c9431888ae4. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} Mar 26 21:26:57.350515 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e719f10a-1137-493f-bffa-571071bd4666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'volume_size': 1, 'snapshot_id': '8ca0c0b0-442e-4827-b82a-e6a6c1fe545e'}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:57.356050 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a65d69c-32bd-45be-b95f-6cb3adac1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:26:57.365978 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Volume volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4 (0bbb91d4-daf0-4273-8d8b-4c9431888ae4): created successfully Mar 26 21:26:57.369876 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a65d69c-32bd-45be-b95f-6cb3adac1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:26:57.375660 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Flow 'volume_create_manager' (d0716c36-e81a-461e-9017-2c2919405d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:26:57.390198 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-ac5269a3-5e22-4774-8d2a-e7bd5c3f4971 tempest-TestVolumeBootPattern-540060077 None] Created volume successfully. Mar 26 21:26:58.307288 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:26:58.308949 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:26:58.359714 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:26:58.414145 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:27:00.854739 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-aa043602-883b-4b21-82b7-2afb03950dc9 req-9136022e-0e0f-46de-a363-855b73b9b320 tempest-TestVolumeBootPattern-540060077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:27:01.732223 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-aa043602-883b-4b21-82b7-2afb03950dc9 req-9136022e-0e0f-46de-a363-855b73b9b320 tempest-TestVolumeBootPattern-540060077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.877s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:27:01.733853 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-aa043602-883b-4b21-82b7-2afb03950dc9 req-9136022e-0e0f-46de-a363-855b73b9b320 tempest-TestVolumeBootPattern-540060077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:27:01.784261 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-aa043602-883b-4b21-82b7-2afb03950dc9 req-9136022e-0e0f-46de-a363-855b73b9b320 tempest-TestVolumeBootPattern-540060077 None] Connection info returned from driver {'name': 'volumes/volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0bbb91d4-daf0-4273-8d8b-4c9431888ae4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0742feaf-a810-4559-b7ba-5f87be756f5c'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:27:01.885662 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-aa043602-883b-4b21-82b7-2afb03950dc9 req-9136022e-0e0f-46de-a363-855b73b9b320 tempest-TestVolumeBootPattern-540060077 None] attachment_update completed successfully. Mar 26 21:27:58.304763 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:27:58.305904 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:27:58.355399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:27:58.389001 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:28:03.511788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:28:03.534966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Flow 'volume_create_manager' (d5bf9a4c-d14b-45de-a390-d243c0a5059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:28:03.542994 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e243ae-a499-44bd-aa28-5454a2f9a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:03.560392 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e243ae-a499-44bd-aa28-5454a2f9a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1992014423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8b9669a-47aa-4380-95db-03adf51809b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d600597d044d62bfa72df67a61c0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:28:03Z,use_quota=True,user_id='d2954748f375411b87550803a8b2d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:03.566198 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988d7f4e-1314-4495-b4a6-ad5ee0cc4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:03.571014 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988d7f4e-1314-4495-b4a6-ad5ee0cc4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:03.576695 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0782013-e70a-47b8-a93c-17a878160f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:03.674874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0782013-e70a-47b8-a93c-17a878160f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8b9669a-47aa-4380-95db-03adf51809b5', 'volume_name': 'volume-a8b9669a-47aa-4380-95db-03adf51809b5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:03.681450 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a83f6e4-8d9c-4701-a31c-bab666933663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:03.685759 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a83f6e4-8d9c-4701-a31c-bab666933663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:03.691979 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3a16-32e5-4488-aee7-249c05de385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:03.693188 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Volume a8b9669a-47aa-4380-95db-03adf51809b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8b9669a-47aa-4380-95db-03adf51809b5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:28:03.693809 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Cloning a8b9669a-47aa-4380-95db-03adf51809b5 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:28:03.704807 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:28:03.715332 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 28, 3, 709978)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:28:03.715827 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:28:03.716350 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:28:03.720933 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:28:03.721661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:28:03.727704 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 28, 3, 725214)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:28:03.728169 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:28:03.728582 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:28:03.741646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:28:03.809120 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] creating snapshot='volume-a8b9669a-47aa-4380-95db-03adf51809b5.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:28:03.962215 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-a8b9669a-47aa-4380-95db-03adf51809b5.clone_snap' to 'volume-a8b9669a-47aa-4380-95db-03adf51809b5' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:28:04.125020 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:28:04.126981 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:28:04.127720 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:28:04.153168 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:28:04.154142 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Marking volume a8b9669a-47aa-4380-95db-03adf51809b5 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:28:04.163397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to a8b9669a-47aa-4380-95db-03adf51809b5. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:28:04.163822 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Creating volume glance metadata for volume a8b9669a-47aa-4380-95db-03adf51809b5 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:28:04.214270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3a16-32e5-4488-aee7-249c05de385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b9669a-47aa-4380-95db-03adf51809b5', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:04.219181 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3ee8e9-ef28-486b-8c78-67f13346002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:04.228487 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Volume volume-a8b9669a-47aa-4380-95db-03adf51809b5 (a8b9669a-47aa-4380-95db-03adf51809b5): created successfully Mar 26 21:28:04.232758 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3ee8e9-ef28-486b-8c78-67f13346002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:04.238461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Flow 'volume_create_manager' (d5bf9a4c-d14b-45de-a390-d243c0a5059b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:28:04.247415 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-55e4c743-9372-4580-905a-47630f717540 tempest-TestVolumeBackupRestore-1318254806 None] Created volume successfully. Mar 26 21:28:04.848809 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-03-26T21:28:04Z,data_timestamp=2022-03-26T21:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5e7cf4fe-3c96-4331-a08b-f822d28b0141,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d7d600597d044d62bfa72df67a61c0bb',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d2954748f375411b87550803a8b2d3ad',volume_id=a8b9669a-47aa-4380-95db-03adf51809b5) Mar 26 21:28:04.850110 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.backup.rpcapi [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] continue_backup in rpcapi backup_id 5e7cf4fe-3c96-4331-a08b-f822d28b0141 {{(pid=134842) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Mar 26 21:28:04.972996 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:28:05.688884 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.715s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:28:05.690678 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8b9669a-47aa-4380-95db-03adf51809b5', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'a8b9669a-47aa-4380-95db-03adf51809b5', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:28:05.707442 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] Initialize volume connection completed successfully. Mar 26 21:28:11.259160 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] Terminate volume connection completed successfully. Mar 26 21:28:11.275880 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-630bd3e1-88a9-4ad4-b37e-064c8fcce968 tempest-TestVolumeBackupRestore-1318254806 None] Remove volume export completed successfully. Mar 26 21:28:12.391966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:28:12.412161 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Flow 'volume_create_manager' (4b03ae98-c2d0-4ccb-b8af-bfd1d2b75556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:28:12.419141 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa5673-3981-4e45-adfb-2089a0823c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.436887 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa5673-3981-4e45-adfb-2089a0823c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:28:12Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5e7cf4fe-3c96-4331-a08b-f822d28b0141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bfbd40d8-0fc0-42c7-a34d-717f8a141508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d600597d044d62bfa72df67a61c0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:28:12Z,use_quota=True,user_id='d2954748f375411b87550803a8b2d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.442303 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebcfa9b-1d91-4a28-b28b-a4bf2a5325d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.446469 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebcfa9b-1d91-4a28-b28b-a4bf2a5325d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.452238 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce1ee5f-d223-450d-9c11-c015490e2a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.456372 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce1ee5f-d223-450d-9c11-c015490e2a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'volume_name': 'volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.461302 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb460e7-bc7c-40c3-b977-09897472169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.465384 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb460e7-bc7c-40c3-b977-09897472169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.470214 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c7910-7503-4783-8f26-53284c1b4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.471287 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Volume bfbd40d8-0fc0-42c7-a34d-717f8a141508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'volume_size': 1} Mar 26 21:28:12.471684 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] creating volume 'volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:28:12.472886 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:28:12.530262 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:28:12.530931 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:28:12.535208 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c7910-7503-4783-8f26-53284c1b4420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.541147 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42846554-dcaf-4cb3-bc36-f0a8b8ca8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:28:12.550925 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Volume volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508 (bfbd40d8-0fc0-42c7-a34d-717f8a141508): created successfully Mar 26 21:28:12.554797 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42846554-dcaf-4cb3-bc36-f0a8b8ca8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:28:12.561677 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Flow 'volume_create_manager' (4b03ae98-c2d0-4ccb-b8af-bfd1d2b75556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:28:12.569630 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Created volume successfully. Mar 26 21:28:13.446043 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:28:14.119341 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.673s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:28:14.120104 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:28:14.134006 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Initialize volume connection completed successfully. Mar 26 21:28:17.880844 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Terminate volume connection completed successfully. Mar 26 21:28:17.901813 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-16c62633-944d-4a08-887c-7c36d307b410 tempest-TestVolumeBackupRestore-1318254806 None] Remove volume export completed successfully. Mar 26 21:28:21.691346 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad req-ab1beaea-7316-411f-8fa6-9b6d464dfd58 tempest-TestVolumeBackupRestore-1318254806 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:28:22.425728 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad req-ab1beaea-7316-411f-8fa6-9b6d464dfd58 tempest-TestVolumeBackupRestore-1318254806 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.734s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:28:22.426541 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad req-ab1beaea-7316-411f-8fa6-9b6d464dfd58 tempest-TestVolumeBackupRestore-1318254806 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:28:22.457618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad req-ab1beaea-7316-411f-8fa6-9b6d464dfd58 tempest-TestVolumeBackupRestore-1318254806 None] Connection info returned from driver {'name': 'volumes/volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bfbd40d8-0fc0-42c7-a34d-717f8a141508', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd9b32870-7e19-4b81-b145-7ffeb6c1d4af'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:28:22.516410 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad req-ab1beaea-7316-411f-8fa6-9b6d464dfd58 tempest-TestVolumeBackupRestore-1318254806 None] attachment_update completed successfully. Mar 26 21:28:58.306622 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:28:58.308084 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:28:58.338513 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:28:58.364813 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:29:06.026380 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-480f8c7f-e780-40b7-9811-2314c31b3950 req-f40edb61-b1f6-4e45-ae0c-ad55bab66509 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:29:06.027530 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-480f8c7f-e780-40b7-9811-2314c31b3950 req-f40edb61-b1f6-4e45-ae0c-ad55bab66509 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment 0742feaf-a810-4559-b7ba-5f87be756f5c. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:29:07.682070 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-0bbb91d4-daf0-4273-8d8b-4c9431888ae4-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:29:07.740822 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:07.827014 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:29:07.835094 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-0bbb91d4-daf0-4273-8d8b-4c9431888ae4 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:29:08.157841 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] Created reservations ['cb098c4a-1257-4fb0-bb1f-767ceec93cc6', '8b239cb9-a6c7-410c-b807-ab4081e59f49', 'afdb696d-b85e-42f7-a9ee-e21aab847acc', '087382d1-80cd-43f9-86db-d942c58cecd0'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:29:08.204427 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:08.228879 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:08.253919 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:29:08.258353 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:29:08.274183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-c8642b7a-ccfc-4dc0-b606-548561ad2728 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-0bbb91d4-daf0-4273-8d8b-4c9431888ae4-delete_volume'" released by "delete_volume" :: held 0.592s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:29:08.811392 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-80150c31-6981-4867-83ad-ebe1d40ba4e0 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-8ca0c0b0-442e-4827-b82a-e6a6c1fe545e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:29:08.813060 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-80150c31-6981-4867-83ad-ebe1d40ba4e0 tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:19.792832 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-7587908e-96b6-46e4-8090-3568f7b6bdef req-76bd3700-8155-4e66-8c89-7dcbf6fd2577 tempest-TestVolumeBackupRestore-1318254806 None] Terminate volume connection completed successfully. Mar 26 21:29:19.793462 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-7587908e-96b6-46e4-8090-3568f7b6bdef req-76bd3700-8155-4e66-8c89-7dcbf6fd2577 tempest-TestVolumeBackupRestore-1318254806 None] Deleting attachment d9b32870-7e19-4b81-b145-7ffeb6c1d4af. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:29:21.483654 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-bfbd40d8-0fc0-42c7-a34d-717f8a141508-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:29:21.518107 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:21.929832 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Volume volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:29:21.954365 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] deleting rbd volume volume-bfbd40d8-0fc0-42c7-a34d-717f8a141508 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:29:21.967943 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-a8b9669a-47aa-4380-95db-03adf51809b5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:29:22.000905 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:22.964823 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] deleting rbd volume volume-a8b9669a-47aa-4380-95db-03adf51809b5 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:29:23.002937 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Created reservations ['803f019f-31c6-4128-8845-d8d84571ef33', '4a368afe-69e1-4eab-9c40-938cf9702ce7', '39934344-479b-4a0a-9081-4310e3af5760', 'd00e6a72-c787-4f63-b2a8-15d8045a220a'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:29:23.050522 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:23.078116 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:23.104448 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:29:23.109424 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Deleted volume successfully. Mar 26 21:29:23.122461 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9021488e-90bb-4c73-8501-865f618f07e1 tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-bfbd40d8-0fc0-42c7-a34d-717f8a141508-delete_volume'" released by "delete_volume" :: held 1.639s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:29:23.152606 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:29:23.185490 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] deleting parent snapshot volume-a8b9669a-47aa-4380-95db-03adf51809b5.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:29:24.023379 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] Created reservations ['dcafb671-4f05-4b88-87b8-298d9b8fd8eb', '6010bfb0-d1aa-4c67-9fcc-d4ae2b6a84a0', '01c76642-911c-4cfa-a84b-4a8e266ef39a', '2ce833fc-c313-4183-b0b1-1b4d0259ca13'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:29:24.068772 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:24.093697 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:24.120085 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:29:24.125113 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] Deleted volume successfully. Mar 26 21:29:24.136927 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-dd45d874-7ae3-44b1-a66e-b63fb548d7cb tempest-TestVolumeBackupRestore-1318254806 None] Lock "b'cinder-a8b9669a-47aa-4380-95db-03adf51809b5-delete_volume'" released by "delete_volume" :: held 2.169s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:29:38.963212 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-80150c31-6981-4867-83ad-ebe1d40ba4e0 tempest-TestVolumeBootPattern-540060077 None] Created reservations ['2f51a82d-5dd6-414b-8e67-3ddc46fb7842', '61f955b6-1665-43f0-b99d-157f160c7e2e', '9918c47a-dd3f-45b0-990a-fab06d8b17e2', 'a39632f8-02d0-42e3-aa47-8525eed2ca7b'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:29:39.000108 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-80150c31-6981-4867-83ad-ebe1d40ba4e0 tempest-TestVolumeBootPattern-540060077 None] Delete snapshot completed successfully. Mar 26 21:29:39.004991 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-80150c31-6981-4867-83ad-ebe1d40ba4e0 tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-8ca0c0b0-442e-4827-b82a-e6a6c1fe545e-delete_snapshot'" released by "delete_snapshot" :: held 30.194s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:29:42.991598 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-0ede652b-a494-433a-ab88-9c8e5d1fb74e req-388b4c4f-3fec-4ab3-b1bf-6ba1f033cdd5 tempest-TestVolumeBootPattern-540060077 None] Terminate volume connection completed successfully. Mar 26 21:29:42.992270 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-0ede652b-a494-433a-ab88-9c8e5d1fb74e req-388b4c4f-3fec-4ab3-b1bf-6ba1f033cdd5 tempest-TestVolumeBootPattern-540060077 None] Deleting attachment 25ebfa4a-ad3f-4066-9eff-74e4dbf41e01. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:29:45.098557 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-44eb25a7-2179-422f-a764-436f790469c5-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:29:45.128918 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:45.191431 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:29:45.198421 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] deleting rbd volume volume-44eb25a7-2179-422f-a764-436f790469c5 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:29:45.412605 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:29:45.445752 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] deleting parent snapshot volume-44eb25a7-2179-422f-a764-436f790469c5.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:29:46.007279 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] Created reservations ['b2010f4d-dfb4-4fef-a0ff-2d4cd0c9a297', 'e2b2f19e-518f-49f8-8970-fbbe0f1cc460', '83db5f81-052b-46de-9ac4-e5ba03d44ebc', 'd12c2c85-a903-4ee5-bd71-e4199a0d0338'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:29:46.054496 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:46.075838 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:46.098643 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:29:46.103639 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] Deleted volume successfully. Mar 26 21:29:46.118256 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-18063777-c551-42c0-8241-0c3705488c6d tempest-TestVolumeBootPattern-540060077 None] Lock "b'cinder-44eb25a7-2179-422f-a764-436f790469c5-delete_volume'" released by "delete_volume" :: held 1.020s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:29:58.310734 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:29:58.311445 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:58.335942 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:29:58.360159 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:30:58.316377 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:30:58.317119 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:30:58.338161 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:30:58.363320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:31:58.317984 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:31:58.318672 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:31:58.348567 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:31:58.379059 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:32:58.318605 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:32:58.319338 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:32:58.359399 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:32:58.407134 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:33:58.323429 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:33:58.324136 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:33:58.345280 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:33:58.367489 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:34:58.322750 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:34:58.323434 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:34:58.344581 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:34:58.366304 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:35:39.661026 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:35:39.683837 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Flow 'volume_create_manager' (90d10701-b23d-4cb2-bf26-a131f5a53347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:35:39.691440 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a70720e-3b69-4c92-a13c-277a66555eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.707432 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a70720e-3b69-4c92-a13c-277a66555eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1081682996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b29693cc-24c7-4ee1-959a-04059d309db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a3c1555504ccaaa90ea06f794d09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:35:40Z,use_quota=True,user_id='dc934eed0dcd45a3a4967a219b7d84a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.713310 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdc1252-307f-4c76-8cfb-f2c919281363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.717810 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdc1252-307f-4c76-8cfb-f2c919281363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.730171 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d092e-9e25-460e-a8af-163341231ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.735604 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d092e-9e25-460e-a8af-163341231ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'volume_name': 'volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.740964 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe09402-adb5-4c69-9341-75b42439e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.745167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe09402-adb5-4c69-9341-75b42439e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.750770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b870fc14-fe9f-4385-8e7b-94e37bbb216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.752161 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Volume b29693cc-24c7-4ee1-959a-04059d309db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'volume_size': 1} Mar 26 21:35:39.752740 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] creating volume 'volume-b29693cc-24c7-4ee1-959a-04059d309db7' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:35:39.753536 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:35:39.825359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:35:39.825740 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:35:39.830144 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b870fc14-fe9f-4385-8e7b-94e37bbb216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.834458 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969731ca-5762-4edd-8bab-de97abb220ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:35:39.843507 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Volume volume-b29693cc-24c7-4ee1-959a-04059d309db7 (b29693cc-24c7-4ee1-959a-04059d309db7): created successfully Mar 26 21:35:39.847802 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969731ca-5762-4edd-8bab-de97abb220ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:35:39.853710 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Flow 'volume_create_manager' (90d10701-b23d-4cb2-bf26-a131f5a53347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:35:39.863375 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-dae9815d-f932-4fbf-acb9-6c3cb9f513b4 tempest-ServerActionsTestJSON-666290772 None] Created volume successfully. Mar 26 21:35:41.201310 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 req-2fe81399-8495-4b71-90d2-78b29e80114f tempest-ServerActionsTestJSON-666290772 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:35:41.834145 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 req-2fe81399-8495-4b71-90d2-78b29e80114f tempest-ServerActionsTestJSON-666290772 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:35:41.834961 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 req-2fe81399-8495-4b71-90d2-78b29e80114f tempest-ServerActionsTestJSON-666290772 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:35:41.857594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 req-2fe81399-8495-4b71-90d2-78b29e80114f tempest-ServerActionsTestJSON-666290772 None] Connection info returned from driver {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '495d6112-1780-4d3d-be33-d01a1fe999ae'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:35:41.901117 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 req-2fe81399-8495-4b71-90d2-78b29e80114f tempest-ServerActionsTestJSON-666290772 None] attachment_update completed successfully. Mar 26 21:35:58.320727 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:35:58.321682 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:35:58.344639 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:35:58.367444 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:36:07.793656 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-cb4a2f75-0e9e-4f01-a912-f2096c2c9b1f tempest-ServerActionsTestJSON-666290772 None] Terminate volume connection completed successfully. Mar 26 21:36:07.794299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-cb4a2f75-0e9e-4f01-a912-f2096c2c9b1f tempest-ServerActionsTestJSON-666290772 None] Deleting attachment 495d6112-1780-4d3d-be33-d01a1fe999ae. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:36:09.913930 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-f126b7f3-e6cf-4f05-959c-be063c415ac1 tempest-ServerActionsTestJSON-666290772 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:36:10.538231 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-f126b7f3-e6cf-4f05-959c-be063c415ac1 tempest-ServerActionsTestJSON-666290772 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.624s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:36:10.539220 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-f126b7f3-e6cf-4f05-959c-be063c415ac1 tempest-ServerActionsTestJSON-666290772 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:36:10.560880 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-f126b7f3-e6cf-4f05-959c-be063c415ac1 tempest-ServerActionsTestJSON-666290772 None] Connection info returned from driver {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b4264b3-b0ee-4529-af84-0ca930c6b6ef'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:36:10.604678 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 req-f126b7f3-e6cf-4f05-959c-be063c415ac1 tempest-ServerActionsTestJSON-666290772 None] attachment_update completed successfully. Mar 26 21:36:16.827321 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-7195536a-32f5-4bff-a96d-aff8fb880bc6 tempest-ServerActionsTestJSON-666290772 None] Terminate volume connection completed successfully. Mar 26 21:36:16.828629 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-7195536a-32f5-4bff-a96d-aff8fb880bc6 tempest-ServerActionsTestJSON-666290772 None] Deleting attachment 0b4264b3-b0ee-4529-af84-0ca930c6b6ef. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:36:19.091455 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-b15d2cc8-9735-437d-bace-e7e4aebab5dd tempest-ServerActionsTestJSON-666290772 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:36:19.717126 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-b15d2cc8-9735-437d-bace-e7e4aebab5dd tempest-ServerActionsTestJSON-666290772 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:36:19.717934 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-b15d2cc8-9735-437d-bace-e7e4aebab5dd tempest-ServerActionsTestJSON-666290772 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:36:19.740711 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-b15d2cc8-9735-437d-bace-e7e4aebab5dd tempest-ServerActionsTestJSON-666290772 None] Connection info returned from driver {'name': 'volumes/volume-b29693cc-24c7-4ee1-959a-04059d309db7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b29693cc-24c7-4ee1-959a-04059d309db7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c40aa05b-82e5-48b9-a44b-acc81f7d72c9'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:36:19.784774 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-7bf108cc-2178-47de-9c7c-aa10ba25e338 req-b15d2cc8-9735-437d-bace-e7e4aebab5dd tempest-ServerActionsTestJSON-666290772 None] attachment_update completed successfully. Mar 26 21:36:27.728842 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 req-898dc2bc-56e1-4ab0-a763-277b0c935b0b tempest-ServerActionsTestJSON-666290772 None] Terminate volume connection completed successfully. Mar 26 21:36:27.729580 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 req-898dc2bc-56e1-4ab0-a763-277b0c935b0b tempest-ServerActionsTestJSON-666290772 None] Deleting attachment c40aa05b-82e5-48b9-a44b-acc81f7d72c9. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:36:29.409982 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Lock "b'cinder-b29693cc-24c7-4ee1-959a-04059d309db7-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:36:29.441004 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:36:29.478802 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:36:29.479252 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Volume volume-b29693cc-24c7-4ee1-959a-04059d309db7 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:36:29.484750 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] deleting rbd volume volume-b29693cc-24c7-4ee1-959a-04059d309db7 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:36:29.674594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Created reservations ['0a23acea-6a70-45f7-b63b-89d0f728ef73', '1e081d8c-0412-4202-93ce-75d03e207c63', 'efcc769a-a32d-4273-a5d9-680a27a0110f', '609f4f2a-45c3-4995-9d95-be207b20601c'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:36:29.715682 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:36:29.748240 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:36:29.770545 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:36:29.775071 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Deleted volume successfully. Mar 26 21:36:29.786688 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-d0862eab-0ceb-4997-a2fb-8aa854fe1385 tempest-ServerActionsTestJSON-666290772 None] Lock "b'cinder-b29693cc-24c7-4ee1-959a-04059d309db7-delete_volume'" released by "delete_volume" :: held 0.377s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:36:58.322743 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:36:58.323456 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:36:58.345071 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:36:58.366350 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:37:58.321023 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:37:58.322306 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:37:58.423381 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:37:58.448228 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:38:01.531186 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:38:01.551490 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Flow 'volume_create_manager' (72512191-efb6-4dc2-9599-51aff5d21aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:38:01.558395 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ab665c-33a9-4c88-a3af-d70bc224cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.574820 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ab665c-33a9-4c88-a3af-d70bc224cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2044960908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b2eb087-9605-4220-89e1-d862ee82bfe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9ed2569761414ba8a5c29042b497d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:38:01Z,use_quota=True,user_id='77f6288194244de28dc65b917c20c3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.580220 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cab54c-8418-48ac-94ed-6fbb5931c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.584433 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cab54c-8418-48ac-94ed-6fbb5931c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.589546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74606a9-260c-4c5f-98b1-98dfec0b5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.593618 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74606a9-260c-4c5f-98b1-98dfec0b5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2eb087-9605-4220-89e1-d862ee82bfe7', 'volume_name': 'volume-1b2eb087-9605-4220-89e1-d862ee82bfe7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.599119 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9dabf5-ed77-4b68-ba00-07fd7ad5f3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.603012 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9dabf5-ed77-4b68-ba00-07fd7ad5f3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.607906 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ad7464-b628-4438-817a-375d2ebda231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.608990 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Volume 1b2eb087-9605-4220-89e1-d862ee82bfe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2eb087-9605-4220-89e1-d862ee82bfe7', 'volume_size': 1} Mar 26 21:38:01.609378 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] creating volume 'volume-1b2eb087-9605-4220-89e1-d862ee82bfe7' {{(pid=134842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}} Mar 26 21:38:01.610138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:38:01.697353 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:38:01.697659 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:38:01.701446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ad7464-b628-4438-817a-375d2ebda231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2eb087-9605-4220-89e1-d862ee82bfe7', 'volume_size': 1}' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.706183 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a84b97-1f8b-4616-bb7c-9de67536b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:38:01.714701 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Volume volume-1b2eb087-9605-4220-89e1-d862ee82bfe7 (1b2eb087-9605-4220-89e1-d862ee82bfe7): created successfully Mar 26 21:38:01.718244 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a84b97-1f8b-4616-bb7c-9de67536b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:38:01.724278 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Flow 'volume_create_manager' (72512191-efb6-4dc2-9599-51aff5d21aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:38:01.731826 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-02399b57-1b7c-499f-b2b7-c4c486d43a65 tempest-TestMinimumBasicScenario-1300155065 None] Created volume successfully. Mar 26 21:38:03.114785 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f20fbd67-5dad-4c71-b956-7652443cfa23 req-6bf4ed99-9f0c-4aed-83f4-9c4bf9ea8a0e tempest-TestMinimumBasicScenario-1300155065 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:38:04.244282 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-f20fbd67-5dad-4c71-b956-7652443cfa23 req-6bf4ed99-9f0c-4aed-83f4-9c4bf9ea8a0e tempest-TestMinimumBasicScenario-1300155065 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.129s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:38:04.244971 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f20fbd67-5dad-4c71-b956-7652443cfa23 req-6bf4ed99-9f0c-4aed-83f4-9c4bf9ea8a0e tempest-TestMinimumBasicScenario-1300155065 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b2eb087-9605-4220-89e1-d862ee82bfe7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '1b2eb087-9605-4220-89e1-d862ee82bfe7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:38:04.264724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f20fbd67-5dad-4c71-b956-7652443cfa23 req-6bf4ed99-9f0c-4aed-83f4-9c4bf9ea8a0e tempest-TestMinimumBasicScenario-1300155065 None] Connection info returned from driver {'name': 'volumes/volume-1b2eb087-9605-4220-89e1-d862ee82bfe7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b2eb087-9605-4220-89e1-d862ee82bfe7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '32d86661-1470-49a4-b0a6-7d6b2e49c9ef'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:38:04.311448 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f20fbd67-5dad-4c71-b956-7652443cfa23 req-6bf4ed99-9f0c-4aed-83f4-9c4bf9ea8a0e tempest-TestMinimumBasicScenario-1300155065 None] attachment_update completed successfully. Mar 26 21:38:58.323470 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:38:58.325164 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:38:58.348014 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:38:58.375299 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:39:22.623512 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-4f0dca73-3680-4d9b-bd69-39ce45918188 req-bbe9ba6e-224a-4b72-a9ab-f3241cc0dfd2 tempest-TestMinimumBasicScenario-1300155065 None] Terminate volume connection completed successfully. Mar 26 21:39:22.624163 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-4f0dca73-3680-4d9b-bd69-39ce45918188 req-bbe9ba6e-224a-4b72-a9ab-f3241cc0dfd2 tempest-TestMinimumBasicScenario-1300155065 None] Deleting attachment 32d86661-1470-49a4-b0a6-7d6b2e49c9ef. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:39:23.137747 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Lock "b'cinder-1b2eb087-9605-4220-89e1-d862ee82bfe7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:39:23.170390 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:39:23.215547 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:39:23.215958 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Volume volume-1b2eb087-9605-4220-89e1-d862ee82bfe7 is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:39:23.222339 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] deleting rbd volume volume-1b2eb087-9605-4220-89e1-d862ee82bfe7 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:39:23.422661 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Created reservations ['de9b7001-d7e2-4159-af86-e3b1553e901b', '61c8f1ed-4f02-4f52-9592-b7aa8ba38004', '1f8854a7-e41c-4d17-8b73-3c9fdc3ab4bf', '69273cef-2913-45f8-b76e-9f70b5215694'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:39:23.465482 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:39:23.486875 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:39:23.509271 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:39:23.514364 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Deleted volume successfully. Mar 26 21:39:23.526087 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-9c5cd645-a0f0-4726-8603-4cbcb5ad4d39 tempest-TestMinimumBasicScenario-1300155065 None] Lock "b'cinder-1b2eb087-9605-4220-89e1-d862ee82bfe7-delete_volume'" released by "delete_volume" :: held 0.388s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:39:58.321057 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:39:58.321724 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:39:58.342599 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:39:58.366385 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:40:58.321825 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:40:58.322523 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:40:58.343683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:40:58.364818 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:41:58.321108 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:41:58.321844 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:41:58.343656 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:41:58.367333 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:42:58.323002 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:42:58.323699 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:42:58.345549 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:42:58.366500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:43:58.321714 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:43:58.322414 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:43:58.344393 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:43:58.365673 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:45:58.321818 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:45:58.322546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:45:58.343192 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:45:58.364993 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:46:58.319650 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:46:58.320400 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:46:58.342225 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:46:58.363874 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:47:58.319714 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:47:58.320500 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:47:58.342092 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:47:58.364047 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:48:58.319748 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:48:58.320533 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:48:58.342730 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:48:58.363972 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:49:58.319295 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:49:58.320018 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:49:58.359247 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:49:58.391373 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:50:58.316736 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:50:58.317468 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:50:58.340877 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:50:58.362164 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:51:42.752966 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Mar 26 21:51:42.773316 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Flow 'volume_create_manager' (235028dc-8ce9-419e-864d-1abc65963d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:51:42.780040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d0692-4faa-4259-b0c6-0c7efc03a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:42.794787 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d0692-4faa-4259-b0c6-0c7efc03a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-03-26T21:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1320401543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=326c9686-53ea-47d5-9695-e8318f3bc5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82e50b0f4249b889d84b7c46dbb448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-03-26T21:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-03-26T21:51:43Z,use_quota=True,user_id='6687c6fa06d244b0a3ddad87237a5d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc2ff8a3-d3a4-4420-b6ba-5ead32766b23),volume_type_id=dc2ff8a3-d3a4-4420-b6ba-5ead32766b23)' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:42.800510 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36fb1d3-0177-4c8d-91b9-e00b5e2f9fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:42.805218 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36fb1d3-0177-4c8d-91b9-e00b5e2f9fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:42.810354 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae22560-cfbc-48e5-a5d9-1c66c8f941ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:42.889474 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae22560-cfbc-48e5-a5d9-1c66c8f941ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '326c9686-53ea-47d5-9695-e8318f3bc5e7', 'volume_name': 'volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:42.895056 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0cd889-78ef-4e51-92c3-ec56be29dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:42.900125 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0cd889-78ef-4e51-92c3-ec56be29dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:42.905006 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cde3ff1-5569-47eb-8d54-88557df2906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:42.906314 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Volume 326c9686-53ea-47d5-9695-e8318f3bc5e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Mar 26 21:51:42.907046 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Cloning 326c9686-53ea-47d5-9695-e8318f3bc5e7 from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb at location (None, None). {{(pid=134842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} Mar 26 21:51:42.917305 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:51:42.926454 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 51, 42, 921548)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:51:42.926891 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:51:42.927290 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Found cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Mar 26 21:51:42.931615 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Lock "b'cinder-4c68d3e3-5768-41fa-883a-78a7564bdbcb'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:51:42.932601 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Attempting to retrieve cache entry for image = 4c68d3e3-5768-41fa-883a-78a7564bdbcb on host ncdv-master-1@ceph#ceph. {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} Mar 26 21:51:42.937935 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Found image-volume cache entry: {'id': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'volume_id': 'abca8fe3-d56e-4a4a-ab6a-c810b06253ac', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41), 'last_used': datetime.datetime(2022, 3, 26, 21, 51, 42, 935800)}. {{(pid=134842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Mar 26 21:51:42.938351 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.image.cache [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Image-volume cache entry image_update_at = 2022-03-26 20:40:41+00:00, requested image updated_at = 2022-03-26 20:40:41+00:00. {{(pid=134842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Mar 26 21:51:42.938745 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Creating from source image-volume abca8fe3-d56e-4a4a-ab6a-c810b06253ac {{(pid=134842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} Mar 26 21:51:42.950079 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:51:43.002361 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] creating snapshot='volume-326c9686-53ea-47d5-9695-e8318f3bc5e7.clone_snap' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}} Mar 26 21:51:43.764313 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] cloning 'volume-abca8fe3-d56e-4a4a-ab6a-c810b06253ac@volume-326c9686-53ea-47d5-9695-e8318f3bc5e7.clone_snap' to 'volume-326c9686-53ea-47d5-9695-e8318f3bc5e7' {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}} Mar 26 21:51:43.901881 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Volume volume-2a3f4905-eb37-4708-be4e-acc1bdcab8e6.deleted is not a clone. {{(pid=134842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}} Mar 26 21:51:43.903040 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}} Mar 26 21:51:43.903419 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}} Mar 26 21:51:43.920788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] clone created successfully {{(pid=134842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}} Mar 26 21:51:43.921424 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.volume_utils [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Marking volume 326c9686-53ea-47d5-9695-e8318f3bc5e7 as bootable. {{(pid=134842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Mar 26 21:51:43.929019 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Copying metadata from image 4c68d3e3-5768-41fa-883a-78a7564bdbcb to 326c9686-53ea-47d5-9695-e8318f3bc5e7. {{(pid=134842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} Mar 26 21:51:43.929396 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Creating volume glance metadata for volume 326c9686-53ea-47d5-9695-e8318f3bc5e7 backed by image 4c68d3e3-5768-41fa-883a-78a7564bdbcb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} Mar 26 21:51:43.977788 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cde3ff1-5569-47eb-8d54-88557df2906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'volume_size': 1, 'image_id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c773729259f41fda13a8dbc3d1e265c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4c68d3e3-5768-41fa-883a-78a7564bdbcb', 'created_at': datetime.datetime(2022, 3, 26, 20, 40, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 3, 26, 20, 40, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:43.982486 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755b1397-4dda-4bf7-b1e9-8fa9f9a15166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Mar 26 21:51:43.990202 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.flows.manager.create_volume [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Volume volume-326c9686-53ea-47d5-9695-e8318f3bc5e7 (326c9686-53ea-47d5-9695-e8318f3bc5e7): created successfully Mar 26 21:51:43.993854 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755b1397-4dda-4bf7-b1e9-8fa9f9a15166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Mar 26 21:51:43.999359 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Flow 'volume_create_manager' (235028dc-8ce9-419e-864d-1abc65963d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Mar 26 21:51:44.007011 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [None req-f616fd38-0e0f-44b1-a81a-ddd20e865017 tempest-TestShelveInstance-2053873640 None] Created volume successfully. Mar 26 21:51:50.848558 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-6b587c03-3fed-4667-8e41-96c1b5318208 req-7b6c1ba7-29da-496f-b71e-6f439943ad45 tempest-TestShelveInstance-2053873640 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:51:51.596888 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-6b587c03-3fed-4667-8e41-96c1b5318208 req-7b6c1ba7-29da-496f-b71e-6f439943ad45 tempest-TestShelveInstance-2053873640 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:51:51.597683 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-6b587c03-3fed-4667-8e41-96c1b5318208 req-7b6c1ba7-29da-496f-b71e-6f439943ad45 tempest-TestShelveInstance-2053873640 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '326c9686-53ea-47d5-9695-e8318f3bc5e7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:51:51.620106 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-6b587c03-3fed-4667-8e41-96c1b5318208 req-7b6c1ba7-29da-496f-b71e-6f439943ad45 tempest-TestShelveInstance-2053873640 None] Connection info returned from driver {'name': 'volumes/volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '326c9686-53ea-47d5-9695-e8318f3bc5e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2cfc7322-ed85-4c53-989a-9facaebe0952'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:51:51.665012 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-6b587c03-3fed-4667-8e41-96c1b5318208 req-7b6c1ba7-29da-496f-b71e-6f439943ad45 tempest-TestShelveInstance-2053873640 None] attachment_update completed successfully. Mar 26 21:51:58.318673 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:51:58.319555 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:51:58.344511 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:51:58.366124 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:52:58.321027 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:52:58.321703 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:52:58.344078 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:52:58.365672 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:53:58.320789 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:53:58.321499 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:53:58.342202 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:53:58.366933 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:54:29.398769 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f488dda8-bc68-42a5-afeb-390e186f5b28 req-b0e4d8ea-f92f-4413-923b-2bbc775e51b8 tempest-TestShelveInstance-2053873640 None] Terminate volume connection completed successfully. Mar 26 21:54:29.399426 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f488dda8-bc68-42a5-afeb-390e186f5b28 req-b0e4d8ea-f92f-4413-923b-2bbc775e51b8 tempest-TestShelveInstance-2053873640 None] Deleting attachment 2cfc7322-ed85-4c53-989a-9facaebe0952. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:54:30.736405 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e req-896c2d81-d0d2-4d21-8562-92430d16235f tempest-TestShelveInstance-2053873640 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 21:54:31.365417 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_concurrency.processutils [req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e req-896c2d81-d0d2-4d21-8562-92430d16235f tempest-TestShelveInstance-2053873640 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=134842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 21:54:31.366790 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e req-896c2d81-d0d2-4d21-8562-92430d16235f tempest-TestShelveInstance-2053873640 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '1493cc71-6667-4e4e-8ff6-afcb7b8fa9bb', 'volume_id': '326c9686-53ea-47d5-9695-e8318f3bc5e7', 'discard': True}} {{(pid=134842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}} Mar 26 21:54:31.389446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e req-896c2d81-d0d2-4d21-8562-92430d16235f tempest-TestShelveInstance-2053873640 None] Connection info returned from driver {'name': 'volumes/volume-326c9686-53ea-47d5-9695-e8318f3bc5e7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '326c9686-53ea-47d5-9695-e8318f3bc5e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '15e29f6c-de0e-4ca0-8dde-2eb794ce9480'} {{(pid=134842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}} Mar 26 21:54:31.434707 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e req-896c2d81-d0d2-4d21-8562-92430d16235f tempest-TestShelveInstance-2053873640 None] attachment_update completed successfully. Mar 26 21:54:58.322510 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:54:58.323478 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:54:58.346713 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:54:58.369888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:55:58.324761 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:55:58.325594 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:55:58.347179 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:55:58.368571 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:56:03.849499 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-0844b80f-81e7-4d81-bec6-ab338c9bd021 tempest-TestShelveInstance-2053873640 None] Terminate volume connection completed successfully. Mar 26 21:56:03.850139 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.manager [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-0844b80f-81e7-4d81-bec6-ab338c9bd021 tempest-TestShelveInstance-2053873640 None] Deleting attachment 15e29f6c-de0e-4ca0-8dde-2eb794ce9480. {{(pid=134842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}} Mar 26 21:56:03.966778 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] Lock "b'cinder-326c9686-53ea-47d5-9695-e8318f3bc5e7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Mar 26 21:56:03.999432 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:56:04.094162 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] volume has no backup snaps {{(pid=134842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}} Mar 26 21:56:04.105653 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] deleting rbd volume volume-326c9686-53ea-47d5-9695-e8318f3bc5e7 {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}} Mar 26 21:56:04.333879 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] volume is a clone so cleaning references {{(pid=134842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}} Mar 26 21:56:04.370760 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] deleting parent snapshot volume-326c9686-53ea-47d5-9695-e8318f3bc5e7.clone_snap {{(pid=134842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}} Mar 26 21:56:04.959397 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.quota [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] Created reservations ['53d05c66-e37f-48cf-8bfb-3d368624505a', '6c779b37-866d-4b0f-9764-7a057e0c94bc', '27135c4b-e5e0-4e04-bb62-1d0cd2697d12', 'b1e78bf4-6405-4a9c-962a-9dc73c289ee3'] {{(pid=134842) reserve /opt/stack/cinder/cinder/quota.py:755}} Mar 26 21:56:05.000431 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:56:05.027269 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:56:05.050538 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:56:05.055576 ncdv-master-1 cinder-volume[134842]: INFO cinder.volume.manager [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] Deleted volume successfully. Mar 26 21:56:05.067052 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.coordination [req-f7ff5f12-b609-4298-9b4f-870d679abcfa req-eae23426-2316-4ef4-8c60-0da86c3efdca tempest-TestShelveInstance-2053873640 None] Lock "b'cinder-326c9686-53ea-47d5-9695-e8318f3bc5e7-delete_volume'" released by "delete_volume" :: held 1.100s {{(pid=134842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Mar 26 21:56:58.323767 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:56:58.324770 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:56:58.346196 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:56:58.376253 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:57:58.321048 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:57:58.321731 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:57:58.344787 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:57:58.366676 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:58:58.322043 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:58:58.322811 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:58:58.462888 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:58:58.492352 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 21:59:58.327715 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 21:59:58.329423 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:59:58.350872 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 21:59:58.378560 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:00:58.323487 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:00:58.324277 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:00:58.348995 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:00:58.373010 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:01:58.328644 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:01:58.329313 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:01:58.351320 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:01:58.372612 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:02:58.327776 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:02:58.328546 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:02:58.349681 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:02:58.371460 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:03:58.326247 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:03:58.326957 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:03:58.348167 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:03:58.371054 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:04:58.325453 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:04:58.326115 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:04:58.347779 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:04:58.368976 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:05:58.324930 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:05:58.325593 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:05:58.348446 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:05:58.373654 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:06:58.329500 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:06:58.330106 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:06:58.351749 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:06:58.374077 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:07:58.329299 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:07:58.329950 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:07:58.350885 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:07:58.372191 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Mar 26 22:08:58.327466 ncdv-master-1 cinder-volume[134842]: DEBUG oslo_service.periodic_task [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Mar 26 22:08:58.328138 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:08:58.349319 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.volume.drivers.rbd [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}} Mar 26 22:08:58.371646 ncdv-master-1 cinder-volume[134842]: DEBUG cinder.manager [None req-e592ed99-4a5a-4ad0-934f-c6d5ce5ae5d7 None None] Notifying Schedulers of capabilities ... {{(pid=134842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}