-- Logs begin at Sat 2022-06-18 20:01:13 UTC, end at Sat 2022-06-18 23:29:24 UTC. -- Jun 18 21:51:33.289988 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jun 18 21:51:36.677413 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=123697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 21:51:36.678061 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=123697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 21:51:37.117079 ncdv-master-1 cinder-volume[123697]: INFO dbcounter [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Registered counter for database cinder Jun 18 21:51:37.136228 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_db.sqlalchemy.engines [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:51:37.143219 ncdv-master-1 cinder-volume[123697]: DEBUG dbcounter [-] [123697] Writer thread running {{(pid=123697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:51:37.443185 ncdv-master-1 cinder-volume[123697]: INFO cinder.rpc [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 18 21:51:37.447841 ncdv-master-1 cinder-volume[123697]: INFO cinder.rpc [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 18 21:51:37.455889 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_db.sqlalchemy.engines [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:51:37.524648 ncdv-master-1 cinder-volume[123697]: INFO cinder.volume.manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Determined volume DB was empty at startup. Jun 18 21:51:37.525317 ncdv-master-1 cinder-volume[123697]: DEBUG cinder.volume.manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=123697) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jun 18 21:51:37.535345 ncdv-master-1 cinder-volume[123697]: INFO cinder.volume.manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 18 21:51:37.536301 ncdv-master-1 cinder-volume[123697]: WARNING stevedore.named [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 18 21:51:37.536987 ncdv-master-1 cinder-volume[123697]: WARNING castellan.key_manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 18 21:51:37.538302 ncdv-master-1 cinder-volume[123697]: WARNING cinder.keymgr.conf_key_mgr [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 18 21:51:37.555952 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_db.sqlalchemy.engines [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:51:37.562056 ncdv-master-1 cinder-volume[123697]: INFO cinder.rpc [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 18 21:51:37.566502 ncdv-master-1 cinder-volume[123697]: INFO cinder.rpc [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Jun 18 21:51:37.567636 ncdv-master-1 cinder-volume[123697]: WARNING stevedore.named [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 18 21:51:37.567735 ncdv-master-1 cinder-volume[123697]: WARNING castellan.key_manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 18 21:51:37.569878 ncdv-master-1 cinder-volume[123697]: INFO cinder.volume.manager [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jun 18 21:51:37.577142 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_db.sqlalchemy.engines [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:51:37.600402 ncdv-master-1 cinder-volume[123697]: INFO oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Starting 1 workers Jun 18 21:51:37.606510 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Started child 123873 {{(pid=123697) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 18 21:51:37.609485 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Full set of CONF: {{(pid=123697) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jun 18 21:51:37.610112 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ******************************************************************************** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 21:51:37.610607 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] Configuration options gathered from: {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 21:51:37.611444 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 21:51:37.611694 ncdv-master-1 cinder-volume[123873]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Jun 18 21:51:37.613155 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 21:51:37.613833 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ================================================================================ {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 21:51:37.615385 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] allow_availability_zone_fallback = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.616341 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] allow_compression_on_image_upload = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.617263 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] allowed_direct_url_schemes = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.618056 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] api_rate_limit = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.618734 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] auth_strategy = keystone {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.619532 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] az_cache_duration = 3600 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.620100 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_availability_zone = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.620731 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_host = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.621363 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.621975 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_stats_polling_interval = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.622558 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backup_api_class = cinder.backup.api.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.623112 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.623853 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backup_name_template = backup-%s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.624490 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backup_use_same_host = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.625103 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backup_use_temp_snapshot = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.625679 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] chap_password = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.626515 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] chap_username = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.627248 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.627858 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_internal_tenant_project_id = 7325bff278b145a5a9112160d2e00a5e {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.628597 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_internal_tenant_user_id = 028b67b31190461b96d35563506b6c8e {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.629358 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cloned_volume_same_az = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.629969 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cluster = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.630525 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] compression_format = gzip {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.631274 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] compute_api_class = cinder.compute.nova.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] config_dir = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] config_source = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] control_exchange = openstack {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.653572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] debug = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.654701 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] default_availability_zone = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.654701 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] default_group_type = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.654701 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.654701 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] default_volume_type = ceph {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.654701 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_client_cert = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_client_cert_key = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_data_namespace = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_ssl_cert_path = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_ssl_cert_verify = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] driver_use_ssl = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655107 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] enable_force_upload = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655670 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Starting volume driver RBDDriver (1.2.0) Jun 18 21:51:37.655763 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] enable_new_services = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655763 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] enable_unsupported_driver = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.655763 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] enabled_backends = ['ceph'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656014 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] enforce_multipath_for_image_xfer = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] filter_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_api_insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_api_servers = ['http://10.222.0.30/image'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_api_ssl_compression = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656097 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_ca_certificates_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_catalog_info = image:glance:publicURL {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_num_retries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.656560 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] glance_request_timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] goodness_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] graceful_shutdown_timeout = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] group_api_class = cinder.group.api.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] host = ncdv-master-1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iet_conf = /etc/iet/ietd.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.657013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_compress_on_upload = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_conversion_address_space_limit = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_conversion_cpu_limit = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_conversion_disable = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_upload_use_cinder_backend = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.661711 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_upload_use_internal_tenant = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_volume_cache_enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_volume_cache_max_count = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] image_volume_cache_max_size_gb = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] init_host_max_objects_retrieval = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] instance_format = [instance: %(uuid)s] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662200 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.662874 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iscsi_iotype = fileio {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.663271 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iscsi_secondary_ip_addresses = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.663744 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iscsi_target_flags = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.664172 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iscsi_write_cache = on {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.664679 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iser_helper = tgtadm {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.665321 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iser_ip_address = 10.222.0.30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.665762 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iser_port = 3260 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.666120 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.666541 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_config_append = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.666925 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.667422 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_dir = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.667781 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.668079 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_options = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.668487 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_rotate_interval = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.669199 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_rotate_interval_type = days {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.669590 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] log_rotation_type = none {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.669886 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.670191 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.670725 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.671222 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.671524 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.672043 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] max_age = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.672365 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] max_logfile_count = 30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.672791 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] max_logfile_size_mb = 200 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.673190 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] max_over_subscription_ratio = 20.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.674279 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] message_reap_interval = 86400 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.674638 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] message_ttl = 2592000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.675036 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] migration_create_volume_timeout_secs = 300 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.675762 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] monkey_patch = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.676137 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] monkey_patch_modules = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.676446 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] my_ip = 10.222.0.30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.676790 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] no_snapshot_gb_quota = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.677164 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] num_iser_scan_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.677748 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] num_shell_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.678319 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] num_volume_device_scan_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.678514 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] nvmet_ns_id = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.679542 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] nvmet_port_id = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.680020 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_max_limit = 1000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.680362 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_ext_list = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.681209 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.681402 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_listen = 0.0.0.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.681750 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_listen_port = 8776 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.682099 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_use_ssl = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.682591 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] osapi_volume_workers = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.683091 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] per_volume_size_limit = -1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.683305 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] periodic_fuzzy_delay = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.683665 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] periodic_interval = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.684225 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] project_id_regex = [0-9a-f\-]+ {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.684638 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] public_endpoint = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.684991 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] publish_errors = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.685528 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_backup_gigabytes = 1000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.685900 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_backups = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.686246 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_consistencygroups = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.686703 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.687057 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_gigabytes = 1000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.687400 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_groups = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.687893 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_snapshots = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.688408 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] quota_volumes = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.689213 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] rate_limit_burst = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.689588 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] rate_limit_except_level = CRITICAL {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.690082 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] rate_limit_interval = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.690436 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] reinit_driver_count = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.690787 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] replication_device = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.691351 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] report_discard_supported = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.691706 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] report_interval = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.692264 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] reservation_clean_interval = 86400 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.692573 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] reservation_expire = 86400 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.692984 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] reserved_percentage = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.693386 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.693739 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.694140 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] rpc_response_timeout = 120 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.694492 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] run_external_periodic_tasks = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.694867 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.695218 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] scst_target_driver = iscsi {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.695587 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] scst_target_iqn_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.695873 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_down_time = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.696240 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] snapshot_name_template = snapshot-%s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.696607 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] snapshot_same_host = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.696979 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] split_loggers = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.697340 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] state_path = /opt/stack/data/cinder {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.697723 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] storage_availability_zone = nova {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.698087 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] storage_protocol = iSCSI {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.698470 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] syslog_log_facility = LOG_USER {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.698829 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] target_helper = lioadm {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.699455 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] target_ip_address = 10.222.0.30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.699865 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] target_port = 3260 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.700234 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.700614 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] target_protocol = iscsi {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.701065 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] trace_flags = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.701577 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] transfer_api_class = cinder.transfer.api.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.701944 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] transport_url = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.702351 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] until_refresh = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.702698 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_chap_auth = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.703045 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_default_quota_class = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.703387 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_eventlog = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.703746 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_journal = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.704089 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_json = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.704436 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_multipath_for_image_xfer = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.704780 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_stderr = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.705478 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] use_syslog = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.705595 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] verify_glance_signatures = enabled {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.705912 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_api_class = cinder.volume.api.API {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.706352 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_backend_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.707017 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_clear = zero {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.707462 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_clear_ionice = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.707703 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_clear_size = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.708253 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.708450 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_copy_bps_limit = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.708757 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_dd_blocksize = 1M {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.709190 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.711936 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_name_template = volume-%s {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.712322 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_service_inithost_offload = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.712709 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volume_usage_audit_period = month {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.713224 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.713599 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] watch_log_file = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.713948 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] zoning_mode = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:51:37.714458 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.714870 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.715306 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_concurrency.disable_process_locking = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.716047 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.716466 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.716825 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.717252 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.717629 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.718327 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.718989 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.admin_password = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.719380 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.720111 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.admin_token = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.720693 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.admin_user = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.721106 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_admin_prefix = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.721726 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.722121 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_port = 35357 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.722504 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_protocol = https {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.722909 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_section = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.723301 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_type = password {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.723666 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_uri = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.724000 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:37.724103 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.auth_version = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.724368 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.cache = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.724750 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.725133 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.725493 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.delay_auth_decision = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.725865 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.726212 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.http_connect_timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.726567 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.726913 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.identity_uri = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.727284 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.include_service_catalog = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.727634 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.728009 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.interface = public {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.728373 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.728801 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.729220 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.729572 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.729929 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.730430 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.730781 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.731147 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.731496 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.732074 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.732424 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.region_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.732797 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.733172 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.service_token_roles_required = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.733594 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.service_type = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.733955 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.token_cache_time = 300 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.734337 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.734812 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.backend = dogpile.cache.null {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.735197 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.backend_argument = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.735555 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.config_prefix = cache.oslo {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.735995 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.dead_timeout = 60.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.736364 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.debug_cache_backend = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.736719 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.enable_retry_client = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.737127 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.enable_socket_keepalive = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.737480 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.737863 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.expiration_time = 600 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.738230 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.hashclient_retry_attempts = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.738596 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.hashclient_retry_delay = 1.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.738944 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_dead_retry = 300 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.739307 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.739651 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.739999 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_pool_maxsize = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.740511 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.740908 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.741291 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.memcache_socket_timeout = 1.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.741671 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.proxies = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.742596 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.retry_attempts = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.742973 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.retry_delay = 0.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.743326 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.socket_keepalive_count = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.743677 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.socket_keepalive_idle = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.744089 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.socket_keepalive_interval = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.744441 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.tls_allowed_ciphers = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.744782 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.tls_cafile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.745167 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.tls_certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.745535 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.tls_enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.745883 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cache.tls_keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.746273 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] coordination.backend_url = etcd3+http://10.222.0.30:2379 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.746725 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.backend = sqlalchemy {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.747034 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.connection = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.747419 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.connection_debug = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.747802 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.connection_parameters = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.748187 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.connection_recycle_time = 3600 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.748545 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.connection_trace = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.748910 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.db_inc_retry_interval = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.749352 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.db_max_retries = 20 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.749708 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.db_max_retry_interval = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.750126 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.db_retry_interval = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.750657 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.max_overflow = 50 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.751014 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.max_pool_size = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.751376 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.max_retries = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.751729 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.mysql_enable_ndb = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.752246 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.752602 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.pool_timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.752970 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.retry_interval = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.753366 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.slave_connection = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.753726 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.sqlite_synchronous = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.754073 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] database.use_db_reconnect = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.754487 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.enforce_new_defaults = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.754839 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.enforce_scope = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.755228 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.policy_default_rule = default {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.755604 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.755986 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.policy_file = policy.yaml {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.756367 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.756737 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.757110 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.757472 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.757816 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.758251 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.connection_string = messaging:// {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.758542 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.758912 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.es_doc_type = notification {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.759251 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.es_scroll_size = 10000 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.759608 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.es_scroll_time = 2m {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.759952 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.filter_error_trace = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.760307 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.hmac_keys = SECRET_KEY {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.760841 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.sentinel_service_name = mymaster {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.761221 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.socket_timeout = 0.1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.761594 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] profiler.trace_sqlalchemy = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.762029 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.capabilities = [21] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.762563 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.group = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.762914 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.helper_command = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.763297 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.763669 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.764009 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] privsep_osbrick.user = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.764401 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.764862 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.group = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.765444 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.helper_command = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.766020 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.766599 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.767183 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] cinder_sys_admin.user = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.767820 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.auth_section = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.768411 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.auth_type = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.769004 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.cafile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.769841 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.770408 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.collect_timing = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.770827 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.771178 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.771541 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.send_service_user_token = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.772053 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.split_loggers = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.774268 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] service_user.timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.774692 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.backend_availability_zone = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.775163 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.775763 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.776389 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.chap_password = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.777082 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.chap_username = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.777996 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.778432 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.778818 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.779171 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_client_cert = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.779530 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_client_cert_key = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.779883 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_data_namespace = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.780229 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.780641 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.781420 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.driver_use_ssl = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.781782 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.enable_deferred_deletion = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.782138 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.enable_unsupported_driver = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.782490 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.782859 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.extra_capabilities = {} {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.783363 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.filter_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.783721 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.goodness_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.784087 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.784647 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.785255 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.785750 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.786551 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.787063 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.787576 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iscsi_iotype = fileio {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.788839 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.790018 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iscsi_target_flags = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.790400 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iscsi_write_cache = on {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.790791 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iser_helper = tgtadm {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.791476 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iser_ip_address = 10.222.0.30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.791839 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iser_port = 3260 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.792204 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.792580 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.792934 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.793767 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.num_shell_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.795295 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.795941 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.796559 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.nvmet_port_id = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.796997 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rados_connect_timeout = -1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.797452 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rados_connection_interval = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.798179 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rados_connection_retries = 3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.798638 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_ceph_conf = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.799111 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_cluster_name = ceph {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.799518 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.799951 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.800382 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.800835 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_pool = rbd {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.801315 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_secret_uuid = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.801999 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.802463 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.rbd_user = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.803016 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.replication_connect_timeout = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.803457 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.replication_device = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.803883 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.report_discard_supported = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.804323 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.804748 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.reserved_percentage = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.805222 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.scst_target_driver = iscsi {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.805633 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.scst_target_iqn_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.806070 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.storage_protocol = iSCSI {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.806501 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.806938 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.target_helper = tgtadm {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.807221 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:37.807536 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.target_ip_address = 10.222.0.30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.807959 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.target_port = 3260 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.808383 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.808811 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.target_protocol = iscsi {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.809247 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.trace_flags = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.809668 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.unique_fqdn_network = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.810082 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.use_chap_auth = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.810496 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.810919 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_backend_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.811360 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_clear = zero {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.811831 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_clear_ionice = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.812256 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_clear_size = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.812682 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.813127 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.813559 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.813985 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.814512 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.814969 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_reports.file_event_handler = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.815426 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.815850 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_reports.log_dir = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.816513 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.backend_availability_zone = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.816930 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.backend_host = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.817364 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.backend_native_threads_pool_size = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.817773 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.backup_use_temp_snapshot = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.818194 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.chap_password = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.818603 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.chap_username = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.819013 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.chiscsi_conf = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.819424 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.deferred_deletion_delay = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.819827 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.deferred_deletion_purge_interval = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.820242 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_client_cert = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.820683 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_client_cert_key = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.821125 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_data_namespace = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.821534 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_ssl_cert_path = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.821954 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_ssl_cert_verify = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.822387 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.driver_use_ssl = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.822797 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.enable_deferred_deletion = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.823207 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.enable_unsupported_driver = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.823610 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.824015 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.extra_capabilities = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.824965 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.filter_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.824965 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.goodness_function = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.825127 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iet_conf = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.825750 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.image_upload_use_cinder_backend = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.826164 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.image_upload_use_internal_tenant = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.826604 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.image_volume_cache_enabled = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.827033 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.image_volume_cache_max_count = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.827547 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.image_volume_cache_max_size_gb = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.828012 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iscsi_iotype = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.828486 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.828913 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iscsi_target_flags = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.829336 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iscsi_write_cache = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.829740 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iser_helper = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.830143 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iser_ip_address = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.830587 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iser_port = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.830999 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.iser_target_prefix = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.831401 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.max_over_subscription_ratio = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.832117 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.num_iser_scan_tries = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.832536 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.num_shell_tries = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.832948 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.num_volume_device_scan_tries = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.833381 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.nvmet_ns_id = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.833785 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.nvmet_port_id = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.834216 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rados_connect_timeout = -1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.834621 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rados_connection_interval = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.835633 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rados_connection_retries = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.836058 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.836469 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_cluster_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.836881 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.837331 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.837770 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_max_clone_depth = 5 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.838195 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_pool = volumes {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.839375 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_secret_uuid = 9f4b4bf4-6af2-4e15-9589-dd111594dd39 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.839375 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_store_chunk_size = 4 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.839375 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.rbd_user = cinder {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.839675 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.replication_connect_timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.840982 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.replication_device = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.840982 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.report_discard_supported = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.840982 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.report_dynamic_total_capacity = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.841247 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.reserved_percentage = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.841702 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.scst_target_driver = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.842185 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.scst_target_iqn_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.842590 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.storage_protocol = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.843062 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.suppress_requests_ssl_warnings = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.843470 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.target_helper = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.843884 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.target_ip_address = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.845383 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.target_port = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.847157 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.target_prefix = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.847782 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.target_protocol = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.848216 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.trace_flags = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.849365 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.unique_fqdn_network = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.849808 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.use_chap_auth = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.850246 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.use_multipath_for_image_xfer = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.850685 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_backend_name = ceph {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.851099 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_clear = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.851631 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_clear_ionice = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.852043 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_clear_size = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.852455 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.852884 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_copy_bps_limit = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.853292 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_dd_blocksize = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.853716 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.854125 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ceph.volumes_dir = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.854634 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.855080 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.855515 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.855927 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.856384 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.856797 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.857246 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.857657 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.858074 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.858510 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.858935 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.859367 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.859825 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.860258 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.860668 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.861367 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.861797 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.862207 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.862631 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.863037 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.863519 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.863987 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.864514 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.864938 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.865532 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.865946 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.866381 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.866818 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_rabbit.ssl_version = {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.867203 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_notifications.driver = [] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.867626 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_notifications.retry = -1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.868112 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.868542 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] oslo_messaging_notifications.transport_url = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.868919 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.869291 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] key_manager.fixed_key = **** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.869786 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.870219 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.barbican_api_version = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.870631 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.barbican_endpoint = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.871079 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.barbican_endpoint_type = public {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.871445 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.barbican_region_name = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.871877 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.cafile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.872217 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.872750 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.collect_timing = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.873280 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.873759 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.874358 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.number_of_retries = 60 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.874858 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.retry_delay = 1 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.875468 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.send_service_user_token = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.875833 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.split_loggers = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.876178 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.876529 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.verify_ssl = True {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.876893 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican.verify_ssl_path = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.877294 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.auth_section = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.877645 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.auth_type = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.878134 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.cafile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.878791 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.879385 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.collect_timing = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.879894 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.880382 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.880895 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.split_loggers = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.881401 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] barbican_service_user.timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.881916 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.approle_role_id = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.882045 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.driver [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Driver hasn't implemented _init_vendor_properties() Jun 18 21:51:37.882453 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.driver [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:41e1b3da-5658-4f78-a875-e600b926dd2b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123873) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Jun 18 21:51:37.882705 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.approle_secret_id = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.883192 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.cafile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.883677 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.certfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.884733 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.collect_timing = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.885273 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.insecure = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.885888 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.keyfile = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.886398 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.kv_mountpoint = secret {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.886890 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.kv_version = 2 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.887378 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.namespace = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.887936 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.root_token_id = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.888464 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.split_loggers = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.888965 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.ssl_ca_crt_file = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.889530 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.timeout = None {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.890067 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.use_ssl = False {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.890723 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:51:37.891185 ncdv-master-1 cinder-volume[123697]: DEBUG oslo_service.service [None req-fc905b98-c601-4b5c-a302-0c2a4ef3934d None None] ******************************************************************************** {{(pid=123697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 21:51:37.896784 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_db.sqlalchemy.engines [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:51:37.900150 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writer thread running {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:51:37.932117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.db.sqlalchemy.api [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Building query based on filter {{(pid=123873) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3878}} Jun 18 21:51:37.959431 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=123873) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}} Jun 18 21:51:37.965926 ncdv-master-1 cinder-volume[123873]: INFO cinder.keymgr.migration [None req-8c414eea-5dc4-4ea1-baf6-81ad52e8cba3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 18 21:51:37.975094 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:38.016776 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:38.055745 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:51:38.087394 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Driver initialization completed successfully. Jun 18 21:51:38.088623 ncdv-master-1 cinder-volume[123873]: INFO cinder.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Initiating service 3 cleanup Jun 18 21:51:38.105459 ncdv-master-1 cinder-volume[123873]: INFO cinder.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Service 3 cleanup completed. Jun 18 21:51:38.105864 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.service [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Creating RPC server for service cinder-volume {{(pid=123873) start /opt/stack/cinder/cinder/service.py:231}} Jun 18 21:51:38.114378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.service [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=123873) start /opt/stack/cinder/cinder/service.py:237}} Jun 18 21:51:38.167448 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jun 18 21:51:38.168720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:38.196322 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:51:38.247168 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8abb1f50-fe33-4228-a063-1341ee49cdcc None None] Driver post RPC initialization completed successfully. Jun 18 21:51:47.591950 ncdv-master-1 cinder-volume[123697]: DEBUG dbcounter [-] [123697] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=123697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:48.110877 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:48.241740 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=24,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:18.263140 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:18.264848 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:38.266950 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:47.251464 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:52:47.252629 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:52:47.279249 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:52:47.304073 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:52:58.278513 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:18.274745 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:28.292830 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:47.249325 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:53:47.249988 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:53:47.276638 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:53:47.302591 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:53:48.290046 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:54:08.294372 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:54:28.302303 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:54:38.312840 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:54:47.247478 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:54:47.248176 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:54:47.271825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:54:47.294730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:54:58.318220 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:54:58.321535 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:18.325377 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:28.333359 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:47.249813 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:55:47.250526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:55:47.273192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:55:47.297620 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:55:48.343875 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:48.345462 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:56:28.338684 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:56:28.340108 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:56:47.252725 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:56:47.253905 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:56:47.281775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:56:47.306179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:56:58.336806 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:56:58.352281 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:57:38.345490 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:57:38.347436 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:57:47.251815 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:57:47.252867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:57:47.286091 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:57:47.309128 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:58:18.341258 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:58:18.343744 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:58:47.254579 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:58:47.255784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:58:47.290736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:58:47.313342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:58:48.344179 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:58:58.352971 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:18.345079 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:28.349270 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:38.360003 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:47.258332 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 21:59:47.259446 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:59:47.291901 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 21:59:47.314555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 21:59:58.369075 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:58.370077 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:00:18.376804 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:00:18.377962 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:00:47.261204 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:00:47.261859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:00:47.285849 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:00:47.310069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:00:48.372692 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:00:58.372348 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:08.383990 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:28.380948 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:28.389566 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:47.268809 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:01:47.269525 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:01:47.334834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:01:47.391564 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:01:58.389637 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:08.386528 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:28.391497 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:38.396847 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:08.389066 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:18.376728 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:47.269498 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:03:47.273619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:03:47.388537 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:03:47.452031 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:03:48.389332 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:48.391453 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:08.383232 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:28.385786 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:47.268086 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:04:47.268977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:04:47.330119 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:04:47.368875 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:04:48.376320 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:08.377317 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:28.371975 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:47.264741 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:05:47.266105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:05:47.343909 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:05:47.396981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:05:48.365618 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:08.373659 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:12.252488 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:06:12.303918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (a7e838a9-0f4d-4f50-a939-283928b7c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:12.310444 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd2b686-dc68-41d6-bf05-e755196fd448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.369635 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd2b686-dc68-41d6-bf05-e755196fd448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-858232613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b4e05a3-834c-4089-a905-b3e5772b00c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c35ef36a81442b69cd93edc50ecb5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:06:12Z,use_quota=True,user_id='681cfb0e560145b4abef98dbd417f3e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.373961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044dd813-f2aa-428b-a86b-518f6a95fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.378312 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044dd813-f2aa-428b-a86b-518f6a95fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.382669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854bac19-780a-4bd6-82a5-45056a187d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.386617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854bac19-780a-4bd6-82a5-45056a187d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4e05a3-834c-4089-a905-b3e5772b00c7', 'volume_name': 'volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.391969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1a8aed-3a09-4de6-a64b-dd03c46921e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.395790 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1a8aed-3a09-4de6-a64b-dd03c46921e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.400250 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb308d-646a-4cb9-9478-1ebf56b3e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.401352 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Volume 2b4e05a3-834c-4089-a905-b3e5772b00c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'volume_size': 1} Jun 18 22:06:12.401931 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] creating volume 'volume-2b4e05a3-834c-4089-a905-b3e5772b00c7' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:06:12.402860 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:06:12.794690 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:06:12.795418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:06:12.799657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb308d-646a-4cb9-9478-1ebf56b3e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.804452 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e73a40-86df-4eef-831e-c34476770ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:12.820480 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Volume volume-2b4e05a3-834c-4089-a905-b3e5772b00c7 (2b4e05a3-834c-4089-a905-b3e5772b00c7): created successfully Jun 18 22:06:12.824954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e73a40-86df-4eef-831e-c34476770ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:12.831662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (a7e838a9-0f4d-4f50-a939-283928b7c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:12.850279 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6fb1b481-fdda-4e05-8ebf-3ea3523fbde4 tempest-LiveMigrationTest-536907989 None] Created volume successfully. Jun 18 22:06:14.638404 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 req-afc31126-fead-402c-853a-2992d6141de1 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:06:15.726809 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 req-afc31126-fead-402c-853a-2992d6141de1 tempest-LiveMigrationTest-536907989 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.092s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:06:15.726809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 req-afc31126-fead-402c-853a-2992d6141de1 tempest-LiveMigrationTest-536907989 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '2b4e05a3-834c-4089-a905-b3e5772b00c7', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:06:15.791817 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 req-afc31126-fead-402c-853a-2992d6141de1 tempest-LiveMigrationTest-536907989 None] Connection info returned from driver {'name': 'volumes/volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2b4e05a3-834c-4089-a905-b3e5772b00c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e2f1ad28-8a23-49dc-acc2-c30a96489ade'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:06:15.989217 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 req-afc31126-fead-402c-853a-2992d6141de1 tempest-LiveMigrationTest-536907989 None] attachment_update completed successfully. Jun 18 22:06:19.094955 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:19.104764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:06:19.126489 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Flow 'volume_create_manager' (6f6cb56f-8107-4fd8-b5c3-ed7beb6867f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:19.133808 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8daa9b-e760-46c1-b0bd-1674ef99db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.153023 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8daa9b-e760-46c1-b0bd-1674ef99db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1627893619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d71779f-37fd-44be-ba52-f5b168d0a55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a85ed67a4b4908b724c49a9754d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:06:19Z,use_quota=True,user_id='8ede0902f6cf47fc8bbcec812fd9615b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.158463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118ea85f-6394-4abb-928e-500502a91594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.162337 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118ea85f-6394-4abb-928e-500502a91594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.167463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9ccc3a-8d25-4009-b424-7de2adcae28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.172030 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9ccc3a-8d25-4009-b424-7de2adcae28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d71779f-37fd-44be-ba52-f5b168d0a55d', 'volume_name': 'volume-6d71779f-37fd-44be-ba52-f5b168d0a55d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.177108 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc11ea3-cd8d-4aa2-9e4c-eb4d00868536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.181483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc11ea3-cd8d-4aa2-9e4c-eb4d00868536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.186040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a7ff73-6987-4224-8b71-d45c0ae99a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.187102 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Volume 6d71779f-37fd-44be-ba52-f5b168d0a55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d71779f-37fd-44be-ba52-f5b168d0a55d', 'volume_size': 1} Jun 18 22:06:19.187513 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] creating volume 'volume-6d71779f-37fd-44be-ba52-f5b168d0a55d' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:06:19.188281 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:06:19.254533 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:06:19.255010 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:06:19.259277 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a7ff73-6987-4224-8b71-d45c0ae99a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d71779f-37fd-44be-ba52-f5b168d0a55d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.263879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa386e1-c327-4a77-a853-e09f37bd4e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:19.275822 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Volume volume-6d71779f-37fd-44be-ba52-f5b168d0a55d (6d71779f-37fd-44be-ba52-f5b168d0a55d): created successfully Jun 18 22:06:19.280185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa386e1-c327-4a77-a853-e09f37bd4e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:19.286453 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Flow 'volume_create_manager' (6f6cb56f-8107-4fd8-b5c3-ed7beb6867f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:19.296245 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-07e9021e-db45-47c1-8d9c-c598f723097e tempest-DeleteServersTestJSON-1102121297 None] Created volume successfully. Jun 18 22:06:21.459499 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-469d3b20-2856-4429-8135-cf4735ebbfa7 req-c505cf3c-4bde-4e71-96bc-d7eecf788ccf tempest-DeleteServersTestJSON-1102121297 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:06:22.434153 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-469d3b20-2856-4429-8135-cf4735ebbfa7 req-c505cf3c-4bde-4e71-96bc-d7eecf788ccf tempest-DeleteServersTestJSON-1102121297 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.975s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:06:22.434957 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-469d3b20-2856-4429-8135-cf4735ebbfa7 req-c505cf3c-4bde-4e71-96bc-d7eecf788ccf tempest-DeleteServersTestJSON-1102121297 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6d71779f-37fd-44be-ba52-f5b168d0a55d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '6d71779f-37fd-44be-ba52-f5b168d0a55d', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:06:22.461549 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-469d3b20-2856-4429-8135-cf4735ebbfa7 req-c505cf3c-4bde-4e71-96bc-d7eecf788ccf tempest-DeleteServersTestJSON-1102121297 None] Connection info returned from driver {'name': 'volumes/volume-6d71779f-37fd-44be-ba52-f5b168d0a55d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6d71779f-37fd-44be-ba52-f5b168d0a55d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d643925-02b9-4d3b-a470-031ba14bdf4f'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:06:22.512466 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-469d3b20-2856-4429-8135-cf4735ebbfa7 req-c505cf3c-4bde-4e71-96bc-d7eecf788ccf tempest-DeleteServersTestJSON-1102121297 None] attachment_update completed successfully. Jun 18 22:06:28.405853 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-7e9bca14-e7b6-4107-bbf3-853852fe9490 tempest-LiveMigrationTest-1049720124 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:06:29.445844 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-7e9bca14-e7b6-4107-bbf3-853852fe9490 tempest-LiveMigrationTest-1049720124 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.039s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:06:29.446567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-7e9bca14-e7b6-4107-bbf3-853852fe9490 tempest-LiveMigrationTest-1049720124 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '2b4e05a3-834c-4089-a905-b3e5772b00c7', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:06:29.484316 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-7e9bca14-e7b6-4107-bbf3-853852fe9490 tempest-LiveMigrationTest-1049720124 None] Connection info returned from driver {'name': 'volumes/volume-2b4e05a3-834c-4089-a905-b3e5772b00c7', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2b4e05a3-834c-4089-a905-b3e5772b00c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2d967d45-e4b7-4338-8dec-d2ce70a3cdde'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:06:29.542052 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-7e9bca14-e7b6-4107-bbf3-853852fe9490 tempest-LiveMigrationTest-1049720124 None] attachment_update completed successfully. Jun 18 22:06:32.665913 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:06:32.688794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Flow 'volume_create_manager' (488a4397-915f-44eb-a5cc-8d6c0eab5046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:32.696421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5035e10b-d3de-411c-9495-6a254332beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.718340 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5035e10b-d3de-411c-9495-6a254332beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-998816367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68f2c433-eb73-4288-b1bb-b962f15c37ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0a0c26a5b846f0a657fa8810da9d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:06:33Z,use_quota=True,user_id='76897f7be7494bb589de747493240449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.723466 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021a23c2-1783-4b6e-8734-731637089906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.727581 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021a23c2-1783-4b6e-8734-731637089906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.732434 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affb8c8c-85ff-43a1-80dc-caea42b9a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.736500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affb8c8c-85ff-43a1-80dc-caea42b9a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f2c433-eb73-4288-b1bb-b962f15c37ce', 'volume_name': 'volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.741003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd8dd9-d2b4-4b2e-bcd4-86d927823124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.744726 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd8dd9-d2b4-4b2e-bcd4-86d927823124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.749238 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ead9332-c590-48c1-a7de-b6efad80f928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.750278 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume 68f2c433-eb73-4288-b1bb-b962f15c37ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'volume_size': 1} Jun 18 22:06:32.750712 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] creating volume 'volume-68f2c433-eb73-4288-b1bb-b962f15c37ce' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:06:32.751430 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:06:32.810926 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:06:32.811720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:06:32.816501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ead9332-c590-48c1-a7de-b6efad80f928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.821902 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03897163-2cb4-40c3-a4d3-c6568932a13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:32.831814 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume volume-68f2c433-eb73-4288-b1bb-b962f15c37ce (68f2c433-eb73-4288-b1bb-b962f15c37ce): created successfully Jun 18 22:06:32.835425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03897163-2cb4-40c3-a4d3-c6568932a13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:32.840803 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Flow 'volume_create_manager' (488a4397-915f-44eb-a5cc-8d6c0eab5046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:32.850420 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-68c160ff-71b2-4a53-a493-d040f46aaacb tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Created volume successfully. Jun 18 22:06:35.712527 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a req-5783617e-e101-4deb-83b2-29e94ddff0bc tempest-DeleteServersTestJSON-1102121297 None] Terminate volume connection completed successfully. Jun 18 22:06:35.713196 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a req-5783617e-e101-4deb-83b2-29e94ddff0bc tempest-DeleteServersTestJSON-1102121297 None] Deleting attachment 7d643925-02b9-4d3b-a470-031ba14bdf4f. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:06:36.453896 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 req-c51640b9-1119-46e9-b1ec-8b1d5ac5ecf2 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:06:37.364092 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 req-c51640b9-1119-46e9-b1ec-8b1d5ac5ecf2 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.910s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:06:37.366176 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 req-c51640b9-1119-46e9-b1ec-8b1d5ac5ecf2 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '68f2c433-eb73-4288-b1bb-b962f15c37ce', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:06:37.396366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 req-c51640b9-1119-46e9-b1ec-8b1d5ac5ecf2 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Connection info returned from driver {'name': 'volumes/volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '68f2c433-eb73-4288-b1bb-b962f15c37ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'db410fa8-e0e3-429f-8092-dec7c2995ddd'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:06:37.455934 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 req-c51640b9-1119-46e9-b1ec-8b1d5ac5ecf2 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] attachment_update completed successfully. Jun 18 22:06:45.237835 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=60,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:45.239638 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-8b322380-8111-41b4-b102-472d8dfb7bc1 tempest-LiveMigrationTest-1049720124 None] Terminate volume connection completed successfully. Jun 18 22:06:45.240491 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-61819d53-2623-4f26-a382-aac99f2da8f9 req-8b322380-8111-41b4-b102-472d8dfb7bc1 tempest-LiveMigrationTest-1049720124 None] Deleting attachment e2f1ad28-8a23-49dc-acc2-c30a96489ade. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:06:47.269616 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:06:47.271475 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:06:47.308949 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:06:47.362617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:06:54.409389 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=50,cinder:UPDATE=10 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:54.438820 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 req-1afb9539-6487-47cc-bd7a-79f9f3bff219 tempest-LiveMigrationTest-536907989 None] Terminate volume connection completed successfully. Jun 18 22:06:54.441465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 req-1afb9539-6487-47cc-bd7a-79f9f3bff219 tempest-LiveMigrationTest-536907989 None] Deleting attachment 2d967d45-e4b7-4338-8dec-d2ce70a3cdde. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:06:55.052825 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bb0a9093-fca5-45f3-8f9d-428ca87ca2af tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:06:55.995975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:06:56.019772 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (acd73182-4bc4-4e19-802a-e5642c9b00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:06:56.043739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f152a659-006e-476f-ada0-c6e144c4496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:56.049745 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bb0a9093-fca5-45f3-8f9d-428ca87ca2af tempest-LiveAutoBlockMigrationV225Test-1069095063 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.997s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:06:56.050643 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bb0a9093-fca5-45f3-8f9d-428ca87ca2af tempest-LiveAutoBlockMigrationV225Test-1069095063 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '68f2c433-eb73-4288-b1bb-b962f15c37ce', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:06:56.073442 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f152a659-006e-476f-ada0-c6e144c4496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2082922507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa66e756-7e7b-41ce-aa13-407ac178ec3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c35ef36a81442b69cd93edc50ecb5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:06:56Z,use_quota=True,user_id='681cfb0e560145b4abef98dbd417f3e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:56.078962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6d6166-54cd-4feb-ad54-610364efb62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:56.083328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6d6166-54cd-4feb-ad54-610364efb62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:56.088284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe72c4-737f-4a82-a9a2-9057145c1d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:56.118590 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bb0a9093-fca5-45f3-8f9d-428ca87ca2af tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Connection info returned from driver {'name': 'volumes/volume-68f2c433-eb73-4288-b1bb-b962f15c37ce', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '68f2c433-eb73-4288-b1bb-b962f15c37ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '03eb4d06-a2bd-48a4-815f-a84cb3873851'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:06:56.192816 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bb0a9093-fca5-45f3-8f9d-428ca87ca2af tempest-LiveAutoBlockMigrationV225Test-1069095063 None] attachment_update completed successfully. Jun 18 22:06:56.221717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe72c4-737f-4a82-a9a2-9057145c1d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'volume_name': 'volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:56.226938 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec448952-227a-4b8b-9531-11a672edfeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:56.231257 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec448952-227a-4b8b-9531-11a672edfeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:06:56.237882 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288e852d-cf4a-4147-b741-756970f56827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:06:56.239023 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume aa66e756-7e7b-41ce-aa13-407ac178ec3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:06:56.239736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Cloning aa66e756-7e7b-41ce-aa13-407ac178ec3c from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:06:56.250559 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:06:56.262134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Preparing cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:882}} Jun 18 22:06:56.264314 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:07:07.118875 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bd02b1df-beb5-43e0-a993-aadc57e674e8 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Terminate volume connection completed successfully. Jun 18 22:07:07.120567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-97554269-09fe-49c6-b57b-632d46f5e3df req-bd02b1df-beb5-43e0-a993-aadc57e674e8 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Deleting attachment db410fa8-e0e3-429f-8092-dec7c2995ddd. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:07:15.512280 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph, size 616.00 MB, duration 19.24 sec {{(pid=123873) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}} Jun 18 22:07:15.512905 ncdv-master-1 cinder-volume[123873]: INFO cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Image download 616.00 MB at 32.02 MB/s Jun 18 22:07:15.590042 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:15.774753 ncdv-master-1 sudo[138821]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph Jun 18 22:07:15.775629 ncdv-master-1 sudo[138821]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:17.110111 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:18.231227 ncdv-master-1 sudo[138821]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:18.233226 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph" returned: 0 in 2.643s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:18.238215 ncdv-master-1 cinder-volume[123873]: WARNING py.warnings [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 18 22:07:18.238215 ncdv-master-1 cinder-volume[123873]: debtcollector.deprecate( Jun 18 22:07:18.238215 ncdv-master-1 cinder-volume[123873]: Jun 18 22:07:18.238950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Temporary image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad is fetched for user 681cfb0e560145b4abef98dbd417f3e0. {{(pid=123873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}} Jun 18 22:07:18.326771 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=31,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:18.355382 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:18.571977 ncdv-master-1 sudo[138903]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph Jun 18 22:07:18.573938 ncdv-master-1 sudo[138903]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:21.515122 ncdv-master-1 sudo[138903]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:21.519689 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph" returned: 0 in 3.165s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:21.521297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] creating volume 'volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:07:21.522702 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:21.634489 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:07:21.634882 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:07:21.658954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Attempting download of 5a3e12b2-cae5-4235-b8ef-6052c81f2dad ((None, None)) to volume aa66e756-7e7b-41ce-aa13-407ac178ec3c. {{(pid=123873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1181}} Jun 18 22:07:21.706842 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-5e817e84-479a-4d8f-bd48-909a594d72f5 req-e0da7371-2703-47fc-bad4-95afc710b339 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Terminate volume connection completed successfully. Jun 18 22:07:21.707259 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-5e817e84-479a-4d8f-bd48-909a594d72f5 req-e0da7371-2703-47fc-bad4-95afc710b339 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Deleting attachment 03eb4d06-a2bd-48a4-815f-a84cb3873851. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:07:21.751971 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_6lu8gm6x {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:21.965964 ncdv-master-1 sudo[138998]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_6lu8gm6x Jun 18 22:07:21.966968 ncdv-master-1 sudo[138998]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:24.434088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:07:24.477528 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Flow 'volume_create_manager' (bbd9d711-5902-4655-882e-9a28a5dc4a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:07:24.507519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940386f3-8a7e-478c-a171-3772da6ae5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:24.561267 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940386f3-8a7e-478c-a171-3772da6ae5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1120779251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7ddbb47-4767-4642-b519-69ecfb1831d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0a0c26a5b846f0a657fa8810da9d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:07:24Z,use_quota=True,user_id='76897f7be7494bb589de747493240449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:24.567072 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898b942b-5116-4114-af89-bf762008eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:24.572256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898b942b-5116-4114-af89-bf762008eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:24.579585 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13819a1-1a4a-483b-987e-3c9251d2bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:24.640056 ncdv-master-1 sudo[138998]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:24.641743 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_6lu8gm6x" returned: 0 in 2.890s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:24.642354 ncdv-master-1 cinder-volume[123873]: WARNING py.warnings [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 18 22:07:24.642354 ncdv-master-1 cinder-volume[123873]: debtcollector.deprecate( Jun 18 22:07:24.642354 ncdv-master-1 cinder-volume[123873]: Jun 18 22:07:24.643223 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:24.776508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13819a1-1a4a-483b-987e-3c9251d2bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7ddbb47-4767-4642-b519-69ecfb1831d9', 'volume_name': 'volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:24.796310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ddb87f-d9ba-4f4b-817c-e551087853d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:24.820775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ddb87f-d9ba-4f4b-817c-e551087853d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:24.834196 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2e436c-aafa-4afd-ae2c-735a9c0865df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:24.840528 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume f7ddbb47-4767-4642-b519-69ecfb1831d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:07:24.841669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Cloning f7ddbb47-4767-4642-b519-69ecfb1831d9 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:07:24.931475 ncdv-master-1 sudo[139037]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph Jun 18 22:07:24.933251 ncdv-master-1 sudo[139037]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:26.771572 ncdv-master-1 sudo[139037]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:26.773962 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph" returned: 0 in 2.131s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:26.775275 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] 5a3e12b2-cae5-4235-b8ef-6052c81f2dad was vhdx, converting to raw {{(pid=123873) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}} Jun 18 22:07:26.776564 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8peofrhx {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:26.829869 ncdv-master-1 sudo[139056]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8peofrhx Jun 18 22:07:26.831461 ncdv-master-1 sudo[139056]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:29.736984 ncdv-master-1 sudo[139056]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:29.740805 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp8peofrhx" returned: 0 in 2.964s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:29.741977 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:30.026949 ncdv-master-1 sudo[139141]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph Jun 18 22:07:30.028017 ncdv-master-1 sudo[139141]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 18 22:07:32.716449 ncdv-master-1 sudo[139141]: pam_unix(sudo:session): session closed for user root Jun 18 22:07:32.718731 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph" returned: 0 in 2.977s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:32.719457 ncdv-master-1 cinder-volume[123873]: WARNING py.warnings [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 18 22:07:32.719457 ncdv-master-1 cinder-volume[123873]: debtcollector.deprecate( Jun 18 22:07:32.719457 ncdv-master-1 cinder-volume[123873]: Jun 18 22:07:32.720172 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a3e12b2-cae5-4235-b8ef-6052c81f2dad_uqd0n299ncdv-master-1@ceph, size 700.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/conversion/tmp8peofrhx {{(pid=123873) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}} Jun 18 22:07:32.720538 ncdv-master-1 cinder-volume[123873]: INFO cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Converted 700.00 MB image at 236.08 MB/s Jun 18 22:07:32.721995 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:32.901351 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:07:32.914812 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:07:32.939268 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] deleting rbd volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:07:33.343220 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp8peofrhx volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:34.556184 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:38.414858 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:38.558246 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp8peofrhx volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.216s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:38.885968 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:39.103053 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:07:39.104836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:07:39.108548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Downloaded image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad ((None, None)) to volume aa66e756-7e7b-41ce-aa13-407ac178ec3c successfully. {{(pid=123873) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1223}} Jun 18 22:07:39.234968 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Temporary image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad for user 681cfb0e560145b4abef98dbd417f3e0 is deleted. {{(pid=123873) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}} Jun 18 22:07:39.322918 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:07:39.323732 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:07:39.465113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Created reservations ['cff11d97-d48a-4bee-bbdf-dcc4cb9c836b', 'fa3c678a-27f3-466a-9352-058befc7a9cc', '2ced48e7-74a4-46b9-ae32-259ee2441e4b', '2e654e35-c0a0-4206-8367-3ba8c7e87d41'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:07:39.480121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Creating image volume entry: {'ec2_id': None, 'display_description': None, 'volume_metadata': [], 'service_uuid': None, 'volume_type_id': 'f09357f8-d9b5-4c4e-a3ec-43ae84e236bc', 'replication_extended_status': None, 'consistencygroup_id': None, 'host': 'ncdv-master-1@ceph#ceph', 'terminated_at': None, 'availability_zone': 'nova', 'encryption_key_id': None, 'deleted': False, 'volume_admin_metadata': [], 'multiattach': False, 'replication_driver_data': None, 'provider_id': None, 'updated_at': datetime.datetime(2022, 6, 18, 22, 6, 56, tzinfo=datetime.timezone.utc), 'display_name': 'image-5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'size': 1, 'provider_auth': None, 'shared_targets': True, 'created_at': datetime.datetime(2022, 6, 18, 22, 6, 56, tzinfo=datetime.timezone.utc), 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'metadata': {}, 'replication_status': None, 'provider_geometry': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'bootable': False, 'scheduled_at': datetime.datetime(2022, 6, 18, 22, 6, 56, tzinfo=datetime.timezone.utc), 'cluster_name': None, 'provider_location': None, 'deleted_at': None, 'group_id': None, 'launched_at': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c'}. {{(pid=123873) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1620}} Jun 18 22:07:39.622817 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume reschedule parameters: False retry: None {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:07:39.673463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (90861328-1e73-45ba-a26f-e4ee79ae68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:07:39.684320 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f68d0a-d120-494c-97ea-5069e66be774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:39.718670 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f68d0a-d120-494c-97ea-5069e66be774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='image-5a3e12b2-cae5-4235-b8ef-6052c81f2dad',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0526064b-f11a-4258-bed1-9a39e5a985f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7325bff278b145a5a9112160d2e00a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=aa66e756-7e7b-41ce-aa13-407ac178ec3c,status='creating',terminated_at=None,updated_at=2022-06-18T22:06:56Z,use_quota=True,user_id='681cfb0e560145b4abef98dbd417f3e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:39.724009 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab8927a-22eb-42e0-8218-e635ed7e7725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:39.746691 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab8927a-22eb-42e0-8218-e635ed7e7725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:39.760867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d73201-2421-42ce-9845-3ebefd025cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:39.795526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d73201-2421-42ce-9845-3ebefd025cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'volume_name': 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6', 'volume_size': 1, 'source_volid': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'source_volstatus': 'downloading'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:39.813088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd67b0e-85ed-463a-a34f-b8045207bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:39.823365 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd67b0e-85ed-463a-a34f-b8045207bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:39.833725 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a27ce27-af1d-40e9-8195-8bf3bc2b896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:39.835207 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume 0526064b-f11a-4258-bed1-9a39e5a985f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6', 'volume_size': 1, 'source_volid': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'source_volstatus': 'downloading'} Jun 18 22:07:39.878468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:40.030604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] creating snapshot='volume-0526064b-f11a-4258-bed1-9a39e5a985f6.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:07:41.176253 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] cloning 'volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c@volume-0526064b-f11a-4258-bed1-9a39e5a985f6.clone_snap' to 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:07:41.373420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:07:41.375269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:07:41.375883 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:07:41.420479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:07:41.425567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a27ce27-af1d-40e9-8195-8bf3bc2b896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6', 'volume_size': 1, 'source_volid': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'source_volstatus': 'downloading'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:41.431289 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec3b01f-a923-47d3-8af4-b49b3c3bd2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:41.452065 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume volume-0526064b-f11a-4258-bed1-9a39e5a985f6 (0526064b-f11a-4258-bed1-9a39e5a985f6): created successfully Jun 18 22:07:41.469360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec3b01f-a923-47d3-8af4-b49b3c3bd2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:41.485541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (90861328-1e73-45ba-a26f-e4ee79ae68a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:07:41.513970 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Created volume successfully. Jun 18 22:07:41.609756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Creating new image-volume cache entry for image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on ncdv-master-1@ceph#ceph {{(pid=123873) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jun 18 22:07:41.630447 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] New image-volume cache entry created: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 7, 41, 618814)}. {{(pid=123873) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jun 18 22:07:41.641655 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 45.389s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:07:41.645188 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Marking volume aa66e756-7e7b-41ce-aa13-407ac178ec3c as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:07:41.674539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to aa66e756-7e7b-41ce-aa13-407ac178ec3c. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:07:41.675030 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Creating volume glance metadata for volume aa66e756-7e7b-41ce-aa13-407ac178ec3c backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:07:41.859082 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288e852d-cf4a-4147-b741-756970f56827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:41.866086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9223cb-ba2d-4e45-8d9c-d23b23009ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:41.886645 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c (aa66e756-7e7b-41ce-aa13-407ac178ec3c): created successfully Jun 18 22:07:41.914166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9223cb-ba2d-4e45-8d9c-d23b23009ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:41.923286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Flow 'volume_create_manager' (acd73182-4bc4-4e19-802a-e5642c9b00a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:07:41.939124 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1460c9e5-64b9-40cd-8b7c-97e405876fb7 tempest-LiveMigrationTest-536907989 None] Created volume successfully. Jun 18 22:07:42.200396 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 17.348s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:07:42.216619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 7, 42, 207423)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:07:42.217694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:07:42.222060 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:07:42.240063 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:07:42.241019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:07:42.260164 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 7, 42, 253014)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:07:42.260586 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:07:42.260979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:07:42.319744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:42.438127 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] creating snapshot='volume-f7ddbb47-4767-4642-b519-69ecfb1831d9.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:07:43.211670 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-f7ddbb47-4767-4642-b519-69ecfb1831d9.clone_snap' to 'volume-f7ddbb47-4767-4642-b519-69ecfb1831d9' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:07:43.466437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:07:43.469787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:07:43.470555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:07:43.522347 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:07:43.522973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Marking volume f7ddbb47-4767-4642-b519-69ecfb1831d9 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:07:43.536596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to f7ddbb47-4767-4642-b519-69ecfb1831d9. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:07:43.537012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Creating volume glance metadata for volume f7ddbb47-4767-4642-b519-69ecfb1831d9 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:07:43.666501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2e436c-aafa-4afd-ae2c-735a9c0865df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:43.676620 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd437db8-21e0-4633-880c-b282671a6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:07:43.689747 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume volume-f7ddbb47-4767-4642-b519-69ecfb1831d9 (f7ddbb47-4767-4642-b519-69ecfb1831d9): created successfully Jun 18 22:07:43.695126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd437db8-21e0-4633-880c-b282671a6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:07:43.712315 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Flow 'volume_create_manager' (bbd9d711-5902-4655-882e-9a28a5dc4a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:07:43.729396 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-048e075e-9370-4101-8374-1a0bb23d0ead tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Created volume successfully. Jun 18 22:07:47.268829 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:07:47.269644 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:47.337346 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:07:47.413359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:07:48.971324 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-45a1166f-7203-4505-a4d3-17e9cb38b963 req-a96c09b4-5dc5-4727-9cf3-1ed275f5f575 tempest-LiveMigrationTest-536907989 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:50.405606 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-45a1166f-7203-4505-a4d3-17e9cb38b963 req-a96c09b4-5dc5-4727-9cf3-1ed275f5f575 tempest-LiveMigrationTest-536907989 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.434s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:50.407248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-45a1166f-7203-4505-a4d3-17e9cb38b963 req-a96c09b4-5dc5-4727-9cf3-1ed275f5f575 tempest-LiveMigrationTest-536907989 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:07:50.474847 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-45a1166f-7203-4505-a4d3-17e9cb38b963 req-a96c09b4-5dc5-4727-9cf3-1ed275f5f575 tempest-LiveMigrationTest-536907989 None] Connection info returned from driver {'name': 'volumes/volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca2e2591-037a-4635-9c28-b46b06b5231f'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:07:50.579753 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-45a1166f-7203-4505-a4d3-17e9cb38b963 req-a96c09b4-5dc5-4727-9cf3-1ed275f5f575 tempest-LiveMigrationTest-536907989 None] attachment_update completed successfully. Jun 18 22:07:54.901447 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=62,cinder:INSERT=25,cinder:UPDATE=10,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:54.910634 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-015dafa0-2b65-4838-a545-bc36b1e4e411 req-6c6028fb-f3f8-406a-b5af-17bf108ffc26 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:07:56.120525 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-015dafa0-2b65-4838-a545-bc36b1e4e411 req-6c6028fb-f3f8-406a-b5af-17bf108ffc26 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.218s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:07:56.122009 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-015dafa0-2b65-4838-a545-bc36b1e4e411 req-6c6028fb-f3f8-406a-b5af-17bf108ffc26 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f7ddbb47-4767-4642-b519-69ecfb1831d9', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:07:56.162365 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-015dafa0-2b65-4838-a545-bc36b1e4e411 req-6c6028fb-f3f8-406a-b5af-17bf108ffc26 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Connection info returned from driver {'name': 'volumes/volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7ddbb47-4767-4642-b519-69ecfb1831d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '81fc418e-c40c-45aa-8627-04726e914c92'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:07:56.198696 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=68,cinder:UPDATE=21,cinder:INSERT=11 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:56.291815 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-015dafa0-2b65-4838-a545-bc36b1e4e411 req-6c6028fb-f3f8-406a-b5af-17bf108ffc26 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] attachment_update completed successfully. Jun 18 22:08:05.340944 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:08:05.426673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (ac8f00e1-b1e0-41c5-a539-925ec51e2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:05.464333 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7395216b-4737-435d-8b2f-dee7abbb076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:05.495031 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7395216b-4737-435d-8b2f-dee7abbb076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-486360671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf0825c5-efd0-466f-b40a-5de8da952467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637c113ab85b43cb815b1e6e2d868a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:08:05Z,use_quota=True,user_id='1b0598fbccf348148fda392a40bf0078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:05.501615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98796d75-8d4e-4db8-9300-b65304aeaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:05.513618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98796d75-8d4e-4db8-9300-b65304aeaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:05.529747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e70ed95-ac9c-4d09-b012-a1eda4c67aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:05.678520 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e70ed95-ac9c-4d09-b012-a1eda4c67aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf0825c5-efd0-466f-b40a-5de8da952467', 'volume_name': 'volume-cf0825c5-efd0-466f-b40a-5de8da952467', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:05.685242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708b0077-d6e6-4d7b-b245-bce62706d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:05.692234 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708b0077-d6e6-4d7b-b245-bce62706d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:05.701712 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8b7bb-ddf0-499a-b62c-2fdd906e1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:05.711988 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Volume cf0825c5-efd0-466f-b40a-5de8da952467: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf0825c5-efd0-466f-b40a-5de8da952467', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:08:05.714341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Cloning cf0825c5-efd0-466f-b40a-5de8da952467 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:08:05.739836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:08:05.758986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 8, 5, 751867)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:08:05.759599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:08:05.760204 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:08:05.770040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:08:05.770831 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:08:05.781394 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 8, 5, 775172)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:08:05.782539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:08:05.783032 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:08:05.804923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:08:05.899228 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] creating snapshot='volume-cf0825c5-efd0-466f-b40a-5de8da952467.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:08:06.042143 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-cf0825c5-efd0-466f-b40a-5de8da952467.clone_snap' to 'volume-cf0825c5-efd0-466f-b40a-5de8da952467' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:08:06.287308 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:08:06.289654 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:08:06.290275 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:08:06.327545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:08:06.328543 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Marking volume cf0825c5-efd0-466f-b40a-5de8da952467 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:08:06.343984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to cf0825c5-efd0-466f-b40a-5de8da952467. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:08:06.345167 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Creating volume glance metadata for volume cf0825c5-efd0-466f-b40a-5de8da952467 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:08:06.512924 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8b7bb-ddf0-499a-b62c-2fdd906e1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0825c5-efd0-466f-b40a-5de8da952467', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:06.520937 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e88aa-cf6b-4a3a-ab3d-1c5dcdf7ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:06.540159 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-cf0825c5-efd0-466f-b40a-5de8da952467 (cf0825c5-efd0-466f-b40a-5de8da952467): created successfully Jun 18 22:08:06.545876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e88aa-cf6b-4a3a-ab3d-1c5dcdf7ee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:06.562293 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (ac8f00e1-b1e0-41c5-a539-925ec51e2db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:06.582764 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-18564541-37be-4d94-b786-d9fa03b96543 tempest-TaggedBootDevicesTest-1883771144 None] Created volume successfully. Jun 18 22:08:08.000625 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:08:08.026111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (9186e28f-2e0b-4047-b59c-ea849aa2e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:08.032848 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ca2d27-e82c-4102-b803-2e75e1cda8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.057621 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ca2d27-e82c-4102-b803-2e75e1cda8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1930730042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b01b938-d2cd-4134-a6f2-3145c57622ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637c113ab85b43cb815b1e6e2d868a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:08:08Z,use_quota=True,user_id='1b0598fbccf348148fda392a40bf0078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.063611 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f933ec-26be-48b4-a604-33043ed36f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.076611 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f933ec-26be-48b4-a604-33043ed36f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.082003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213cb474-06ab-4fb3-9503-f38daf22c267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.096223 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213cb474-06ab-4fb3-9503-f38daf22c267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b01b938-d2cd-4134-a6f2-3145c57622ca', 'volume_name': 'volume-1b01b938-d2cd-4134-a6f2-3145c57622ca', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.102291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57677848-b05d-468d-b500-9010f2a80d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.106991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57677848-b05d-468d-b500-9010f2a80d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.112607 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b006eba-6f34-4594-bd71-ab7a5fae7142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.114357 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Volume 1b01b938-d2cd-4134-a6f2-3145c57622ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b01b938-d2cd-4134-a6f2-3145c57622ca', 'volume_size': 1} Jun 18 22:08:08.114966 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] creating volume 'volume-1b01b938-d2cd-4134-a6f2-3145c57622ca' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:08:08.115964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:08:08.222214 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:08:08.222857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:08:08.236780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b006eba-6f34-4594-bd71-ab7a5fae7142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b01b938-d2cd-4134-a6f2-3145c57622ca', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.247945 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f29b67-51f3-4cb7-97fa-8d76625cee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:08.272747 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-1b01b938-d2cd-4134-a6f2-3145c57622ca (1b01b938-d2cd-4134-a6f2-3145c57622ca): created successfully Jun 18 22:08:08.279302 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f29b67-51f3-4cb7-97fa-8d76625cee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:08.295366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (9186e28f-2e0b-4047-b59c-ea849aa2e90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:08.316226 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a2440042-7625-4b34-838e-87b8da7f31cf tempest-TaggedBootDevicesTest-1883771144 None] Created volume successfully. Jun 18 22:08:09.604577 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:08:09.631538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (75c23f49-5811-4b2b-9489-ffa9810cb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:09.639697 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec82762-2444-4fe8-af05-b0e9992f85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.695470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec82762-2444-4fe8-af05-b0e9992f85db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1478098600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637c113ab85b43cb815b1e6e2d868a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:08:10Z,use_quota=True,user_id='1b0598fbccf348148fda392a40bf0078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.709237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39921d3d-2c1c-4f25-bc67-dcdcdcff0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.721125 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39921d3d-2c1c-4f25-bc67-dcdcdcff0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.730199 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a9ee48-9aee-4528-abe0-cdab62620ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.734432 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a9ee48-9aee-4528-abe0-cdab62620ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'volume_name': 'volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.739174 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9952ec-692e-4e70-b77b-decced09a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.753519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9952ec-692e-4e70-b77b-decced09a01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.769296 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4519244a-013b-487b-81ca-318057c801e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.770613 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Volume f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'volume_size': 1} Jun 18 22:08:09.771210 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] creating volume 'volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:08:09.772021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:08:09.904309 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:08:09.904793 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:08:09.913394 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4519244a-013b-487b-81ca-318057c801e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.926790 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1357d2-f283-4672-82f7-a7fbebdbf1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:08:09.944400 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b (f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b): created successfully Jun 18 22:08:09.953260 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1357d2-f283-4672-82f7-a7fbebdbf1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:08:09.967126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Flow 'volume_create_manager' (75c23f49-5811-4b2b-9489-ffa9810cb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:08:09.990054 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c8861445-fcde-4458-a637-d067a58be958 tempest-TaggedBootDevicesTest-1883771144 None] Created volume successfully. Jun 18 22:08:17.484074 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-e274b19c-ec00-49a6-b7d2-818e1ea2b6ea tempest-LiveMigrationTest-1049720124 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:19.339876 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-e274b19c-ec00-49a6-b7d2-818e1ea2b6ea tempest-LiveMigrationTest-1049720124 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.856s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:19.340941 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-e274b19c-ec00-49a6-b7d2-818e1ea2b6ea tempest-LiveMigrationTest-1049720124 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:08:19.399961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-e274b19c-ec00-49a6-b7d2-818e1ea2b6ea tempest-LiveMigrationTest-1049720124 None] Connection info returned from driver {'name': 'volumes/volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa66e756-7e7b-41ce-aa13-407ac178ec3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e888e56f-2aff-4b04-86e6-1c3b653edf57'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:08:19.533145 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-e274b19c-ec00-49a6-b7d2-818e1ea2b6ea tempest-LiveMigrationTest-1049720124 None] attachment_update completed successfully. Jun 18 22:08:20.695928 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-57cfe029-1276-465c-9504-8656b0255830 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:21.965672 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-57cfe029-1276-465c-9504-8656b0255830 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.271s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:21.966494 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-57cfe029-1276-465c-9504-8656b0255830 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f7ddbb47-4767-4642-b519-69ecfb1831d9', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:08:22.013526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-57cfe029-1276-465c-9504-8656b0255830 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Connection info returned from driver {'name': 'volumes/volume-f7ddbb47-4767-4642-b519-69ecfb1831d9', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7ddbb47-4767-4642-b519-69ecfb1831d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5df76e9d-86f9-4d69-b406-ba950c3645b6'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:08:22.171255 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-57cfe029-1276-465c-9504-8656b0255830 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] attachment_update completed successfully. Jun 18 22:08:28.391817 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:28.393436 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=56,cinder:UPDATE=8,cinder:INSERT=12,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:28.528789 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-f735a4b9-e6cb-4cdb-b10b-36b1a053110b tempest-LiveMigrationTest-1049720124 None] Terminate volume connection completed successfully. Jun 18 22:08:28.533345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 req-f735a4b9-e6cb-4cdb-b10b-36b1a053110b tempest-LiveMigrationTest-1049720124 None] Deleting attachment ca2e2591-037a-4635-9c28-b46b06b5231f. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:08:39.526827 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-a12d4815-3453-4af6-a17f-536209fb404d tempest-TaggedBootDevicesTest-1883771144 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:40.754072 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-a12d4815-3453-4af6-a17f-536209fb404d tempest-TaggedBootDevicesTest-1883771144 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.229s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:40.754930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-a12d4815-3453-4af6-a17f-536209fb404d tempest-TaggedBootDevicesTest-1883771144 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cf0825c5-efd0-466f-b40a-5de8da952467', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'cf0825c5-efd0-466f-b40a-5de8da952467', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:08:40.860217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-a12d4815-3453-4af6-a17f-536209fb404d tempest-TaggedBootDevicesTest-1883771144 None] Connection info returned from driver {'name': 'volumes/volume-cf0825c5-efd0-466f-b40a-5de8da952467', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cf0825c5-efd0-466f-b40a-5de8da952467', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d58e442-43a7-4159-95bd-5319ddd3970f'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:08:40.985107 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-a12d4815-3453-4af6-a17f-536209fb404d tempest-TaggedBootDevicesTest-1883771144 None] attachment_update completed successfully. Jun 18 22:08:41.588227 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-2782acac-f764-403d-921b-72c342f731e8 tempest-TaggedBootDevicesTest-1883771144 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:42.799914 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-2782acac-f764-403d-921b-72c342f731e8 tempest-TaggedBootDevicesTest-1883771144 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.212s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:42.801746 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-2782acac-f764-403d-921b-72c342f731e8 tempest-TaggedBootDevicesTest-1883771144 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b01b938-d2cd-4134-a6f2-3145c57622ca', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '1b01b938-d2cd-4134-a6f2-3145c57622ca', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:08:42.831807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-2782acac-f764-403d-921b-72c342f731e8 tempest-TaggedBootDevicesTest-1883771144 None] Connection info returned from driver {'name': 'volumes/volume-1b01b938-d2cd-4134-a6f2-3145c57622ca', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b01b938-d2cd-4134-a6f2-3145c57622ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '801fed18-49d0-461a-bc5a-04b65cf208d3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:08:42.893064 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-2782acac-f764-403d-921b-72c342f731e8 tempest-TaggedBootDevicesTest-1883771144 None] attachment_update completed successfully. Jun 18 22:08:43.463669 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-3bf42195-93cf-43ba-89a9-b52ac4d6db8f tempest-TaggedBootDevicesTest-1883771144 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:44.481122 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-3bf42195-93cf-43ba-89a9-b52ac4d6db8f tempest-TaggedBootDevicesTest-1883771144 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.017s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:44.483275 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-3bf42195-93cf-43ba-89a9-b52ac4d6db8f tempest-TaggedBootDevicesTest-1883771144 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:08:44.531309 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-3bf42195-93cf-43ba-89a9-b52ac4d6db8f tempest-TaggedBootDevicesTest-1883771144 None] Connection info returned from driver {'name': 'volumes/volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '77d2d136-1752-45ac-b806-8b6b259c8402'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:08:44.632100 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4b7f8f36-615a-4e37-a537-6e198b75b99f req-3bf42195-93cf-43ba-89a9-b52ac4d6db8f tempest-TaggedBootDevicesTest-1883771144 None] attachment_update completed successfully. Jun 18 22:08:47.269356 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:08:47.271052 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:08:47.339186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:08:47.430451 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:08:57.367690 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-b7ee5a95-59de-40bc-ae34-ae5414066584 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Terminate volume connection completed successfully. Jun 18 22:08:57.369696 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e2007fda-6212-4662-b425-5a1566cc5b3d req-b7ee5a95-59de-40bc-ae34-ae5414066584 tempest-LiveAutoBlockMigrationV225Test-1069095063 None] Deleting attachment 81fc418e-c40c-45aa-8627-04726e914c92. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:09:01.047162 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=41,cinder:UPDATE=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:01.050985 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=42,cinder:UPDATE=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:01.085065 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-df417125-5788-4bc8-b193-d579a8c4d022 tempest-LiveMigrationTest-536907989 None] Terminate volume connection completed successfully. Jun 18 22:09:01.085509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-df417125-5788-4bc8-b193-d579a8c4d022 tempest-LiveMigrationTest-536907989 None] Deleting attachment e888e56f-2aff-4b04-86e6-1c3b653edf57. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:09:01.463669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-aa66e756-7e7b-41ce-aa13-407ac178ec3c-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:09:01.522674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:01.619199 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:09:01.619889 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] volume has clone snapshot(s) {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}} Jun 18 22:09:01.621454 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:09:01.950567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Created reservations ['3bd4a359-4f8f-4db0-94b1-53fac6c0dea4', 'b43db093-628b-4c2f-a4f7-3f6506cfe996', 'bcf3b3d8-087b-4f73-949a-66c789f727d6', '798cbdb2-3560-4557-a43b-122c3db4bf2f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:09:02.087691 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:02.166625 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:02.249181 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:09:02.255958 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Deleted volume successfully. Jun 18 22:09:02.278142 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-ed11f570-6b0b-413f-aab8-f8530da45a1b req-7999cd44-d98c-411e-9732-f4a6862d6a01 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-aa66e756-7e7b-41ce-aa13-407ac178ec3c-delete_volume'" released by "delete_volume" :: held 0.812s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:09:02.508211 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-2b4e05a3-834c-4089-a905-b3e5772b00c7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:09:02.566467 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:02.678509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:09:02.678940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Volume volume-2b4e05a3-834c-4089-a905-b3e5772b00c7 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:09:02.694870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] deleting rbd volume volume-2b4e05a3-834c-4089-a905-b3e5772b00c7 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:09:03.221482 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Created reservations ['863f2d4f-956b-4181-a2b9-1baad2fbf6ce', '561b1f36-4007-408f-835b-5192928d1cbe', '3b9f9498-9ea4-4e15-b7eb-5e205a9c74b2', 'fdf6d122-372a-44ba-aabc-a2cd9df001b9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:09:03.315015 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:03.417492 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:03.497947 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:09:03.502346 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Deleted volume successfully. Jun 18 22:09:03.520592 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4cca6a89-edc2-4566-b4e2-df5ce5f5fc48 tempest-LiveMigrationTest-536907989 None] Lock "b'cinder-2b4e05a3-834c-4089-a905-b3e5772b00c7-delete_volume'" released by "delete_volume" :: held 1.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:09:09.983065 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b690bf7f-1991-48db-9925-1deac6114694 req-340f505b-ff1a-4852-88cc-a3cf862b473d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Terminate volume connection completed successfully. Jun 18 22:09:09.983696 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b690bf7f-1991-48db-9925-1deac6114694 req-340f505b-ff1a-4852-88cc-a3cf862b473d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Deleting attachment 5df76e9d-86f9-4d69-b406-ba950c3645b6. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:09:10.186088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-f7ddbb47-4767-4642-b519-69ecfb1831d9-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:09:10.221489 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:10.355048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:09:10.366152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] deleting rbd volume volume-f7ddbb47-4767-4642-b519-69ecfb1831d9 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:09:10.671225 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:09:10.702265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] deleting parent snapshot volume-f7ddbb47-4767-4642-b519-69ecfb1831d9.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:09:11.315089 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Created reservations ['21738e06-fb89-4df4-813e-3712cc1c956c', '28aae1dc-39a7-4151-b9e5-843649219fbf', '041358dc-7108-4471-9990-76c9a4ef5e0a', '17546c00-993f-4712-9288-a7c5b10b338e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:09:11.419649 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:11.507988 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:11.590731 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:09:11.600408 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Deleted volume successfully. Jun 18 22:09:11.616470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-b690bf7f-1991-48db-9925-1deac6114694 req-a065fc4a-75fc-42c5-ad43-c28108283d58 tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-f7ddbb47-4767-4642-b519-69ecfb1831d9-delete_volume'" released by "delete_volume" :: held 1.430s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:09:11.926729 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-68f2c433-eb73-4288-b1bb-b962f15c37ce-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:09:11.990342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:12.090315 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:09:12.091039 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Volume volume-68f2c433-eb73-4288-b1bb-b962f15c37ce is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:09:12.102118 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] deleting rbd volume volume-68f2c433-eb73-4288-b1bb-b962f15c37ce {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:09:12.551338 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Created reservations ['0fa44f50-797b-4973-adb6-1f098570a142', '0a85f4fb-ae91-4d8f-8421-ad5be47d0291', '454a95ea-9cbb-47f9-887f-20a951b7a618', '62068e15-2ba6-4cbc-8d86-6b0e930f962e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:09:12.663837 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:12.671012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:12.748915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:12.807043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:09:12.811027 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Deleted volume successfully. Jun 18 22:09:12.835821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1a662f37-4c57-42d7-8fcd-030f254cda1d tempest-LiveAutoBlockMigrationV225Test-1058311696 None] Lock "b'cinder-68f2c433-eb73-4288-b1bb-b962f15c37ce-delete_volume'" released by "delete_volume" :: held 0.912s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:09:28.399611 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=49,cinder:UPDATE=35,cinder:INSERT=5,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:47.266844 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:09:47.267642 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:47.347112 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:47.413235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:09:47.433086 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:47.460532 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:09:47.487096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Flow 'volume_create_manager' (9c5fd635-cc5e-41d9-9b0c-a333f9913699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:09:47.496126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad365fd-144e-40b9-9eb8-2bcd038c8832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.516490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad365fd-144e-40b9-9eb8-2bcd038c8832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-470080807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce126d46-5cbf-4f21-a555-25f49af6b2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4643e24233bd4af1a0c020e4d9a474fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:09:47Z,use_quota=True,user_id='cf9fa8d3d2bc4f9fa12fab743b7090ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.523007 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d8517e-e140-4661-968e-6c509a127003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.527480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d8517e-e140-4661-968e-6c509a127003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.533880 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bd66c3-7966-4295-bc74-dae153939040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.540853 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bd66c3-7966-4295-bc74-dae153939040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'volume_name': 'volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.547958 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fec62b4-b706-4482-bd75-5eb353edbee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.553748 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fec62b4-b706-4482-bd75-5eb353edbee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.559028 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6221f2a4-604f-4944-a9b1-62902d3c69a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.560392 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Volume ce126d46-5cbf-4f21-a555-25f49af6b2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'volume_size': 1} Jun 18 22:09:47.560902 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] creating volume 'volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:09:47.561802 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:09:47.669866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:09:47.670351 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:09:47.684018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6221f2a4-604f-4944-a9b1-62902d3c69a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.688934 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d352d34-285f-41c2-aa60-c8d416e7576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:09:47.700433 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Volume volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae (ce126d46-5cbf-4f21-a555-25f49af6b2ae): created successfully Jun 18 22:09:47.705085 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d352d34-285f-41c2-aa60-c8d416e7576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:09:47.711048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Flow 'volume_create_manager' (9c5fd635-cc5e-41d9-9b0c-a333f9913699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:09:47.722304 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-94fa5634-672c-44e4-b122-ce628436eefe tempest-VolumesAdminNegativeTest-711931070 None] Created volume successfully. Jun 18 22:09:49.193090 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e req-571daf6a-4117-4bf9-9a17-c8da47446b83 tempest-VolumesAdminNegativeTest-711931070 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:09:50.312157 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e req-571daf6a-4117-4bf9-9a17-c8da47446b83 tempest-VolumesAdminNegativeTest-711931070 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.118s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:09:50.314434 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e req-571daf6a-4117-4bf9-9a17-c8da47446b83 tempest-VolumesAdminNegativeTest-711931070 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:09:50.371931 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e req-571daf6a-4117-4bf9-9a17-c8da47446b83 tempest-VolumesAdminNegativeTest-711931070 None] Connection info returned from driver {'name': 'volumes/volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '490c8cd7-387b-4ba0-b1cd-3de4192d2724'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:09:50.463094 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e req-571daf6a-4117-4bf9-9a17-c8da47446b83 tempest-VolumesAdminNegativeTest-711931070 None] attachment_update completed successfully. Jun 18 22:09:55.873155 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f req-2ac7dfb9-6c34-477a-9fd7-32c65eb4b8d4 tempest-VolumesAdminNegativeTest-711931070 None] Terminate volume connection completed successfully. Jun 18 22:09:55.877443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f req-2ac7dfb9-6c34-477a-9fd7-32c65eb4b8d4 tempest-VolumesAdminNegativeTest-711931070 None] Deleting attachment 490c8cd7-387b-4ba0-b1cd-3de4192d2724. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:10:08.405017 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:14.319473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:10:14.371792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Flow 'volume_create_manager' (9c2ec005-35a8-4ae9-9f14-5b64c2d44c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:10:14.383614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753735c9-5471-4f25-83ee-b655e3ccc722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.407840 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753735c9-5471-4f25-83ee-b655e3ccc722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1361849210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b8f9ff8-db9b-412d-a6bb-442c07357ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4643e24233bd4af1a0c020e4d9a474fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:10:14Z,use_quota=True,user_id='cf9fa8d3d2bc4f9fa12fab743b7090ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.430664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9d6fdf-1480-48fb-b096-ee1d4cc60ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.444150 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9d6fdf-1480-48fb-b096-ee1d4cc60ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.455993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115e8fd8-eee9-44d1-9e7d-da06930d1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.468185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115e8fd8-eee9-44d1-9e7d-da06930d1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8f9ff8-db9b-412d-a6bb-442c07357ef4', 'volume_name': 'volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.484557 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca11e581-7725-4edf-afcb-c41b5b61a17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.497500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca11e581-7725-4edf-afcb-c41b5b61a17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.505222 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f532855f-c777-4abc-bdbe-eaabf99862e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.516116 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Volume 7b8f9ff8-db9b-412d-a6bb-442c07357ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4', 'volume_size': 1} Jun 18 22:10:14.517424 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] creating volume 'volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:10:14.518640 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:14.635667 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:10:14.636272 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:10:14.642812 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f532855f-c777-4abc-bdbe-eaabf99862e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.656835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2b3423-cdfc-4954-a708-b36be70c3013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:14.674710 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Volume volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4 (7b8f9ff8-db9b-412d-a6bb-442c07357ef4): created successfully Jun 18 22:10:14.681049 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2b3423-cdfc-4954-a708-b36be70c3013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:14.689673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Flow 'volume_create_manager' (9c2ec005-35a8-4ae9-9f14-5b64c2d44c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:10:14.701348 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-33fe7548-f240-4e83-8fff-a446016ebd22 tempest-VolumesAdminNegativeTest-711931070 None] Created volume successfully. Jun 18 22:10:15.478400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Lock "b'cinder-7b8f9ff8-db9b-412d-a6bb-442c07357ef4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:10:15.514914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:15.616092 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:10:15.616796 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Volume volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:10:15.622229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] deleting rbd volume volume-7b8f9ff8-db9b-412d-a6bb-442c07357ef4 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:10:16.016086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Created reservations ['c6adf7bf-35c3-49e6-be98-8b9ea698ca83', '8bf1b39e-540e-4d8f-bb29-2da59dabcb31', 'e56fa4a7-d7bb-410b-a7a1-9fb4709d0090', 'e1410dc4-df9d-474b-abaf-6e6a6c88b209'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:10:16.082975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:16.144837 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:16.196758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:10:16.202964 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Deleted volume successfully. Jun 18 22:10:16.220662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f3c68c7e-703c-40ea-b827-72bfe01f8c90 tempest-VolumesAdminNegativeTest-711931070 None] Lock "b'cinder-7b8f9ff8-db9b-412d-a6bb-442c07357ef4-delete_volume'" released by "delete_volume" :: held 0.742s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:10:18.416610 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=38,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:21.727903 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Lock "b'cinder-ce126d46-5cbf-4f21-a555-25f49af6b2ae-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:10:21.768374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:21.836606 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:10:21.837149 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Volume volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:10:21.846890 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] deleting rbd volume volume-ce126d46-5cbf-4f21-a555-25f49af6b2ae {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:10:22.257587 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Created reservations ['e5dc60fa-ea0e-48e7-a3a7-26a13c7e4b23', 'ae38fb1e-e4ed-4e68-b9dc-ae6f5b6ee64a', 'da7cb134-470c-4223-953b-c0b26eeb4032', 'f59730cd-efce-4d7e-819b-31b095b665cf'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:10:22.347176 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:22.393906 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:22.434226 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:10:22.444055 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Deleted volume successfully. Jun 18 22:10:22.463523 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1a5bfb66-79ae-4b2c-9aef-9293e19ecaf5 tempest-VolumesAdminNegativeTest-711931070 None] Lock "b'cinder-ce126d46-5cbf-4f21-a555-25f49af6b2ae-delete_volume'" released by "delete_volume" :: held 0.734s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:10:38.423495 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=39,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:42.655687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:10:42.677556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Flow 'volume_create_manager' (8fe96adf-188a-4f76-a52e-7d353d8705e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:10:42.684763 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f178bc2d-cff8-4ce0-aaee-02927d27f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:42.702439 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f178bc2d-cff8-4ce0-aaee-02927d27f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1166871335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a2187ea-feca-4aa9-ba15-d0a896e78836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965efce4648a472eb15b6d1c0f8c6615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:10:43Z,use_quota=True,user_id='48b167cdb1054ef5bfadd851be67e8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:42.708021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84a08bc-eab4-4b1c-9752-fcaae673d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:42.712363 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84a08bc-eab4-4b1c-9752-fcaae673d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:42.718186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625262d-b771-4124-be10-3c053e37ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:42.945759 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625262d-b771-4124-be10-3c053e37ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a2187ea-feca-4aa9-ba15-d0a896e78836', 'volume_name': 'volume-1a2187ea-feca-4aa9-ba15-d0a896e78836', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:42.963251 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20e3700-87b1-4aae-8a77-6338d315d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:42.973542 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20e3700-87b1-4aae-8a77-6338d315d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:42.987935 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6cb552-ea7f-4311-b016-c4d22b56922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:42.991855 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Volume 1a2187ea-feca-4aa9-ba15-d0a896e78836: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a2187ea-feca-4aa9-ba15-d0a896e78836', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:10:42.992937 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Cloning 1a2187ea-feca-4aa9-ba15-d0a896e78836 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:10:43.024320 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:10:43.050778 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 10, 43, 37123)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:10:43.051644 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:10:43.052259 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:10:43.059326 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:10:43.061006 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:10:43.070474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 10, 43, 67562)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:10:43.071419 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:10:43.072010 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:10:43.094481 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:43.220689 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] creating snapshot='volume-1a2187ea-feca-4aa9-ba15-d0a896e78836.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:10:44.187770 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-1a2187ea-feca-4aa9-ba15-d0a896e78836.clone_snap' to 'volume-1a2187ea-feca-4aa9-ba15-d0a896e78836' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:10:44.506946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:10:44.508474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:10:44.509075 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:10:44.547941 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:10:44.548852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Marking volume 1a2187ea-feca-4aa9-ba15-d0a896e78836 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:10:44.559457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 1a2187ea-feca-4aa9-ba15-d0a896e78836. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:10:44.560335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Creating volume glance metadata for volume 1a2187ea-feca-4aa9-ba15-d0a896e78836 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:10:44.668642 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6cb552-ea7f-4311-b016-c4d22b56922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2187ea-feca-4aa9-ba15-d0a896e78836', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:44.680815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636ec6e5-067a-452e-a50f-f439042b9bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:10:44.704934 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Volume volume-1a2187ea-feca-4aa9-ba15-d0a896e78836 (1a2187ea-feca-4aa9-ba15-d0a896e78836): created successfully Jun 18 22:10:44.709098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636ec6e5-067a-452e-a50f-f439042b9bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:10:44.735783 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Flow 'volume_create_manager' (8fe96adf-188a-4f76-a52e-7d353d8705e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:10:44.784723 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-735238fb-61ce-4a7b-8818-46ea16ae6cf3 tempest-ServersTestBootFromVolume-816570874 None] Created volume successfully. Jun 18 22:10:47.270617 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:10:47.271418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:47.353080 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:47.410207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:10:50.169134 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=20,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:50.179231 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 req-e2e9c2e0-5676-4dab-a03c-edef737be89d tempest-ServersTestBootFromVolume-816570874 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:10:50.483747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Lock "b'cinder-6d71779f-37fd-44be-ba52-f5b168d0a55d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:10:50.582003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:50.678259 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:10:50.678708 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Volume volume-6d71779f-37fd-44be-ba52-f5b168d0a55d is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:10:50.687694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] deleting rbd volume volume-6d71779f-37fd-44be-ba52-f5b168d0a55d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:10:51.185129 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Created reservations ['dc033fba-e148-4a29-bfb8-148236618930', 'e6929d4a-cdac-4c23-9c20-390d82d93fe6', '54c29a47-a17f-4a68-a904-0d4013bc9c89', '6f401b08-c3ec-405f-bd3d-531a17e3b449'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:10:51.336117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:51.425139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:10:51.506207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:10:51.510555 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Deleted volume successfully. Jun 18 22:10:51.525883 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-333d113f-60e8-4db6-9398-1a31c3d619dd tempest-DeleteServersTestJSON-1102121297 None] Lock "b'cinder-6d71779f-37fd-44be-ba52-f5b168d0a55d-delete_volume'" released by "delete_volume" :: held 1.042s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:10:51.843692 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 req-e2e9c2e0-5676-4dab-a03c-edef737be89d tempest-ServersTestBootFromVolume-816570874 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.665s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:10:51.844778 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 req-e2e9c2e0-5676-4dab-a03c-edef737be89d tempest-ServersTestBootFromVolume-816570874 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1a2187ea-feca-4aa9-ba15-d0a896e78836', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '1a2187ea-feca-4aa9-ba15-d0a896e78836', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:10:51.884730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 req-e2e9c2e0-5676-4dab-a03c-edef737be89d tempest-ServersTestBootFromVolume-816570874 None] Connection info returned from driver {'name': 'volumes/volume-1a2187ea-feca-4aa9-ba15-d0a896e78836', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1a2187ea-feca-4aa9-ba15-d0a896e78836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e8a54957-ba4b-47db-97db-bdb1d8671169'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:10:51.995012 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 req-e2e9c2e0-5676-4dab-a03c-edef737be89d tempest-ServersTestBootFromVolume-816570874 None] attachment_update completed successfully. Jun 18 22:11:18.419252 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=26,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:18.420944 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=51,cinder:UPDATE=18,cinder:INSERT=15 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:38.427539 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:41.228274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:11:41.276610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (133008a0-4772-4120-bd4f-5eb3c39bca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:41.296525 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fcd9b6-ff0e-4ff3-bc98-4fb0fd650185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:41.345192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fcd9b6-ff0e-4ff3-bc98-4fb0fd650185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1148319653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df050525-1359-4e57-a0a7-5bfc9b675988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ddaa6fbcdf4368a8e9be0d07596178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:11:41Z,use_quota=True,user_id='a8eb1a760d644f97bf3aae882e905b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:41.363385 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f4c520-4895-4a49-82d8-b6b0a90f1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:41.370175 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f4c520-4895-4a49-82d8-b6b0a90f1436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:41.391832 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d7997c-fd4f-45f1-a4bd-0f61b6117c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:41.565419 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d7997c-fd4f-45f1-a4bd-0f61b6117c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df050525-1359-4e57-a0a7-5bfc9b675988', 'volume_name': 'volume-df050525-1359-4e57-a0a7-5bfc9b675988', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:41.570594 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc7e92-e215-4204-b4c4-12997dd18285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:41.620223 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc7e92-e215-4204-b4c4-12997dd18285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:41.644732 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618a6514-7aba-4cda-bb3e-326cbe19d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:41.651394 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume df050525-1359-4e57-a0a7-5bfc9b675988: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df050525-1359-4e57-a0a7-5bfc9b675988', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:11:41.654921 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Cloning df050525-1359-4e57-a0a7-5bfc9b675988 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:11:41.708084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.045s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:11:41.746803 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 11, 41, 728400)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:11:41.747708 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:11:41.748379 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:11:41.757465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.053s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:11:41.758844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:11:41.778907 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 11, 41, 774415)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:11:41.780388 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:11:41.781274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:11:41.823412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:11:41.987623 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] creating snapshot='volume-df050525-1359-4e57-a0a7-5bfc9b675988.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:11:42.436670 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-df050525-1359-4e57-a0a7-5bfc9b675988.clone_snap' to 'volume-df050525-1359-4e57-a0a7-5bfc9b675988' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:11:42.660550 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:11:42.662111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:11:42.662672 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:11:42.703559 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:11:42.704139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Marking volume df050525-1359-4e57-a0a7-5bfc9b675988 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:11:42.716766 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to df050525-1359-4e57-a0a7-5bfc9b675988. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:11:42.717820 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Creating volume glance metadata for volume df050525-1359-4e57-a0a7-5bfc9b675988 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:11:42.824128 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618a6514-7aba-4cda-bb3e-326cbe19d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df050525-1359-4e57-a0a7-5bfc9b675988', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:42.831034 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27797715-7e97-458c-b110-9d366c30bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:42.848950 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-df050525-1359-4e57-a0a7-5bfc9b675988 (df050525-1359-4e57-a0a7-5bfc9b675988): created successfully Jun 18 22:11:42.856404 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27797715-7e97-458c-b110-9d366c30bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:42.865251 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (133008a0-4772-4120-bd4f-5eb3c39bca33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:42.881254 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8e664cb2-5673-43f1-82d7-2ed76b5cf6ff tempest-TaggedBootDevicesTest_v242-1622454662 None] Created volume successfully. Jun 18 22:11:44.077003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:11:44.126290 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (e77d5576-9153-4521-abc5-ad2b6201b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:44.135463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b16b3f-4802-4f29-9f44-1f05cb3c2790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.176199 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b16b3f-4802-4f29-9f44-1f05cb3c2790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-658131045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ddaa6fbcdf4368a8e9be0d07596178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:11:44Z,use_quota=True,user_id='a8eb1a760d644f97bf3aae882e905b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.192237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac23e6b1-39d1-47cb-82a8-6711da13ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.202304 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac23e6b1-39d1-47cb-82a8-6711da13ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.208356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57e899-ca8f-4c46-83ef-5160d7b6edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.223543 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57e899-ca8f-4c46-83ef-5160d7b6edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'volume_name': 'volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.270605 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961eaab1-9cdf-4f20-8d66-59d8c1226a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.288930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961eaab1-9cdf-4f20-8d66-59d8c1226a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.321341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a6e4df-478b-423a-923c-1fc1a6fe31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.323455 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'volume_size': 1} Jun 18 22:11:44.330537 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] creating volume 'volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:11:44.331571 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:11:44.551095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:11:44.551794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:11:44.559192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a6e4df-478b-423a-923c-1fc1a6fe31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.564895 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b89206-4cff-42c2-b323-a311c318dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:44.602344 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b (cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b): created successfully Jun 18 22:11:44.606026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b89206-4cff-42c2-b323-a311c318dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:44.612059 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (e77d5576-9153-4521-abc5-ad2b6201b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:44.635005 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-05736343-f332-4cf8-9e14-6a44bef94935 tempest-TaggedBootDevicesTest_v242-1622454662 None] Created volume successfully. Jun 18 22:11:46.049512 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:11:46.125999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (88abdba5-ff0f-42e0-9689-5ad352a32ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:46.136932 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081700a2-3756-45e5-8bbb-92bebca168f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.167377 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081700a2-3756-45e5-8bbb-92bebca168f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-16318712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=312a3580-badc-4fa9-b41c-122707532350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ddaa6fbcdf4368a8e9be0d07596178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:11:46Z,use_quota=True,user_id='a8eb1a760d644f97bf3aae882e905b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.177355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0315be01-2bb2-4102-99a6-edef7486f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.184416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0315be01-2bb2-4102-99a6-edef7486f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.198921 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202dda4c-e165-45b5-b804-36887c6a0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.204291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202dda4c-e165-45b5-b804-36887c6a0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312a3580-badc-4fa9-b41c-122707532350', 'volume_name': 'volume-312a3580-badc-4fa9-b41c-122707532350', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.214965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8a7be-2a42-47fe-a06a-7ff96b32855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.222709 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8a7be-2a42-47fe-a06a-7ff96b32855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.246468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbdbd29-7dc0-40ea-be57-1e8e8c276f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.246468 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume 312a3580-badc-4fa9-b41c-122707532350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312a3580-badc-4fa9-b41c-122707532350', 'volume_size': 1} Jun 18 22:11:46.251069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] creating volume 'volume-312a3580-badc-4fa9-b41c-122707532350' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:11:46.253969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:11:46.487811 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:11:46.488685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:11:46.494826 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbdbd29-7dc0-40ea-be57-1e8e8c276f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312a3580-badc-4fa9-b41c-122707532350', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.511156 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c1e0c7-5024-4ee9-ab01-1e12c50c419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:11:46.539957 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-312a3580-badc-4fa9-b41c-122707532350 (312a3580-badc-4fa9-b41c-122707532350): created successfully Jun 18 22:11:46.543919 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c1e0c7-5024-4ee9-ab01-1e12c50c419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:11:46.555236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Flow 'volume_create_manager' (88abdba5-ff0f-42e0-9689-5ad352a32ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:11:46.583939 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1fc00268-fd74-406e-bc1d-f9ae40d22981 tempest-TaggedBootDevicesTest_v242-1622454662 None] Created volume successfully. Jun 18 22:11:47.275015 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:11:47.276067 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:11:47.387966 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:11:47.506193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:11:58.423644 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=34,cinder:UPDATE=7,cinder:INSERT=9 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:18.424212 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=27,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:26.014666 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-bf98f3ab-7887-4a02-ae9f-ebf132b80b3d tempest-TaggedBootDevicesTest_v242-1622454662 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:12:27.312305 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-5e039fdb-0359-497f-9597-f6702314ca34 tempest-ServersTestBootFromVolume-816570874 None] Terminate volume connection completed successfully. Jun 18 22:12:27.319400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-5e039fdb-0359-497f-9597-f6702314ca34 tempest-ServersTestBootFromVolume-816570874 None] Deleting attachment e8a54957-ba4b-47db-97db-bdb1d8671169. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:12:27.626773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] Lock "b'cinder-1a2187ea-feca-4aa9-ba15-d0a896e78836-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:12:27.758141 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:27.934536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:12:27.942692 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] deleting rbd volume volume-1a2187ea-feca-4aa9-ba15-d0a896e78836 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:12:28.414095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:12:28.449514 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] deleting parent snapshot volume-1a2187ea-feca-4aa9-ba15-d0a896e78836.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:12:29.387371 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:29.410174 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-bf98f3ab-7887-4a02-ae9f-ebf132b80b3d tempest-TaggedBootDevicesTest_v242-1622454662 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 3.397s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:12:29.432149 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b292b52c-60da-43e4-a715-972ee1961448 req-bf98f3ab-7887-4a02-ae9f-ebf132b80b3d tempest-TaggedBootDevicesTest_v242-1622454662 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df050525-1359-4e57-a0a7-5bfc9b675988', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'df050525-1359-4e57-a0a7-5bfc9b675988', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:12:29.517399 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] Created reservations ['87398cd3-c703-4cbb-8ff4-e57303de201e', 'e8998bfe-5296-4c14-a86a-3159804ac748', '4bf59938-c9f8-4cc9-9507-c9d422b9746b', '1563e976-7936-4ad8-b1f4-3cee6d3e75ae'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:12:29.528940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-bf98f3ab-7887-4a02-ae9f-ebf132b80b3d tempest-TaggedBootDevicesTest_v242-1622454662 None] Connection info returned from driver {'name': 'volumes/volume-df050525-1359-4e57-a0a7-5bfc9b675988', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df050525-1359-4e57-a0a7-5bfc9b675988', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '30aeb351-a734-4560-bb5f-771207dcf6cc'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:12:29.659590 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:29.750570 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:29.905067 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:12:29.914194 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] Deleted volume successfully. Jun 18 22:12:29.923852 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-bf98f3ab-7887-4a02-ae9f-ebf132b80b3d tempest-TaggedBootDevicesTest_v242-1622454662 None] attachment_update completed successfully. Jun 18 22:12:29.960845 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-5c904a72-2cae-4921-8701-fc592a5f0192 req-9fe11688-9507-47f2-aaf6-f86fb4f08d9b tempest-ServersTestBootFromVolume-816570874 None] Lock "b'cinder-1a2187ea-feca-4aa9-ba15-d0a896e78836-delete_volume'" released by "delete_volume" :: held 2.337s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:12:31.053746 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-2b32df94-a6b4-4a3f-af74-58c8de75e8cd tempest-TaggedBootDevicesTest_v242-1622454662 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:12:33.068390 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-2b32df94-a6b4-4a3f-af74-58c8de75e8cd tempest-TaggedBootDevicesTest_v242-1622454662 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.014s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:12:33.071168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b292b52c-60da-43e4-a715-972ee1961448 req-2b32df94-a6b4-4a3f-af74-58c8de75e8cd tempest-TaggedBootDevicesTest_v242-1622454662 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:12:33.149484 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-2b32df94-a6b4-4a3f-af74-58c8de75e8cd tempest-TaggedBootDevicesTest_v242-1622454662 None] Connection info returned from driver {'name': 'volumes/volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5dffe2c8-cab5-4360-ba21-ae5d9057a1fa'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:12:33.260005 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-2b32df94-a6b4-4a3f-af74-58c8de75e8cd tempest-TaggedBootDevicesTest_v242-1622454662 None] attachment_update completed successfully. Jun 18 22:12:33.821532 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-da95a8ea-f477-4ea5-bfe3-97f38154192f tempest-TaggedBootDevicesTest_v242-1622454662 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:12:35.366399 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b292b52c-60da-43e4-a715-972ee1961448 req-da95a8ea-f477-4ea5-bfe3-97f38154192f tempest-TaggedBootDevicesTest_v242-1622454662 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.545s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:12:35.370416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b292b52c-60da-43e4-a715-972ee1961448 req-da95a8ea-f477-4ea5-bfe3-97f38154192f tempest-TaggedBootDevicesTest_v242-1622454662 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-312a3580-badc-4fa9-b41c-122707532350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '312a3580-badc-4fa9-b41c-122707532350', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:12:35.436678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-da95a8ea-f477-4ea5-bfe3-97f38154192f tempest-TaggedBootDevicesTest_v242-1622454662 None] Connection info returned from driver {'name': 'volumes/volume-312a3580-badc-4fa9-b41c-122707532350', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '312a3580-badc-4fa9-b41c-122707532350', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c9fd9fed-d508-4245-a57f-0933fc233188'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:12:35.565577 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b292b52c-60da-43e4-a715-972ee1961448 req-da95a8ea-f477-4ea5-bfe3-97f38154192f tempest-TaggedBootDevicesTest_v242-1622454662 None] attachment_update completed successfully. Jun 18 22:12:42.208378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:12:42.238980 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Flow 'volume_create_manager' (e62665e6-8a58-463e-855d-85a848e2e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:12:42.247463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e043d145-6ba0-42b3-926b-94c979d6a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.271347 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e043d145-6ba0-42b3-926b-94c979d6a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-434202016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a765e6391f4d36bd54b8119d4c84eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:12:42Z,use_quota=True,user_id='65fa96c0dcf948d185e7d5fdcf280fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.280073 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7783048-1856-4ff2-9dd8-748c44e83e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.290416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7783048-1856-4ff2-9dd8-748c44e83e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.298268 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc531616-326f-420c-858d-18f63bab1ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.302896 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc531616-326f-420c-858d-18f63bab1ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8', 'volume_name': 'volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.308396 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf96cfe7-7f0f-4147-9968-7a3cdcfc6ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.313163 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf96cfe7-7f0f-4147-9968-7a3cdcfc6ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.320807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf03789-229d-49bd-ae46-39fab84b8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.322102 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8', 'volume_size': 1} Jun 18 22:12:42.322610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] creating volume 'volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:12:42.323689 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:42.432395 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:12:42.433027 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:12:42.437832 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf03789-229d-49bd-ae46-39fab84b8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.443503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fce4aba-49fb-4c68-9a23-702dbf7d57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:12:42.466802 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8 (c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8): created successfully Jun 18 22:12:42.471502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fce4aba-49fb-4c68-9a23-702dbf7d57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:12:42.479041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Flow 'volume_create_manager' (e62665e6-8a58-463e-855d-85a848e2e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:12:42.496733 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-44e72d02-2641-4064-92f7-4179045e09ae tempest-ServerRescueNegativeTestJSON-1217932637 None] Created volume successfully. Jun 18 22:12:47.272938 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:12:47.274282 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:47.357289 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:12:47.434019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:12:52.487482 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:09.400145 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=38,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:12.685228 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-465644ae-c398-4fc7-ab8a-c910ef00f428 tempest-TaggedBootDevicesTest-1883771144 None] Terminate volume connection completed successfully. Jun 18 22:13:12.689604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-465644ae-c398-4fc7-ab8a-c910ef00f428 tempest-TaggedBootDevicesTest-1883771144 None] Deleting attachment 4d58e442-43a7-4159-95bd-5319ddd3970f. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:13:13.102101 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-3fecd4c4-c7b7-4758-8ba1-55f196e39e7b tempest-TaggedBootDevicesTest-1883771144 None] Terminate volume connection completed successfully. Jun 18 22:13:13.102560 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-3fecd4c4-c7b7-4758-8ba1-55f196e39e7b tempest-TaggedBootDevicesTest-1883771144 None] Deleting attachment 801fed18-49d0-461a-bc5a-04b65cf208d3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:13:13.268712 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-ea6cbfa2-2899-4028-b713-0f2f4b274ade tempest-TaggedBootDevicesTest-1883771144 None] Terminate volume connection completed successfully. Jun 18 22:13:13.269379 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-0640e090-79d7-499d-bb6b-1f8b28e250ed req-ea6cbfa2-2899-4028-b713-0f2f4b274ade tempest-TaggedBootDevicesTest-1883771144 None] Deleting attachment 77d2d136-1752-45ac-b806-8b6b259c8402. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:13:14.870050 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:13:14.904084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Flow 'volume_create_manager' (60809fa3-66bc-4c10-bdb2-a7f07a4d7863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:13:14.912660 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02e5f11-7208-4add-a1ce-9151d2e62197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:14.933111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02e5f11-7208-4add-a1ce-9151d2e62197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1330459866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d48035a-208e-4c79-b4c3-8bbff016c991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a765e6391f4d36bd54b8119d4c84eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:13:15Z,use_quota=True,user_id='65fa96c0dcf948d185e7d5fdcf280fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:14.939767 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07d0f33-6193-4453-9d10-197e9e6f5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:14.944382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07d0f33-6193-4453-9d10-197e9e6f5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:14.966624 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80c7c0c-06cf-4eb6-921a-4e00fede2845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:14.979333 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80c7c0c-06cf-4eb6-921a-4e00fede2845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d48035a-208e-4c79-b4c3-8bbff016c991', 'volume_name': 'volume-8d48035a-208e-4c79-b4c3-8bbff016c991', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:15.012795 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d26fd5e-a50c-4f28-896f-033fe9bbae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:15.031026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d26fd5e-a50c-4f28-896f-033fe9bbae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:15.052820 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb7aefd-97e2-408c-add0-ce0523f610ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:15.058170 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume 8d48035a-208e-4c79-b4c3-8bbff016c991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d48035a-208e-4c79-b4c3-8bbff016c991', 'volume_size': 1} Jun 18 22:13:15.058754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] creating volume 'volume-8d48035a-208e-4c79-b4c3-8bbff016c991' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:13:15.060817 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:15.212563 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:13:15.213175 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:13:15.217540 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb7aefd-97e2-408c-add0-ce0523f610ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d48035a-208e-4c79-b4c3-8bbff016c991', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:15.228095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d23108-4b6f-45b6-8ab3-02c23a999440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:15.250809 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume volume-8d48035a-208e-4c79-b4c3-8bbff016c991 (8d48035a-208e-4c79-b4c3-8bbff016c991): created successfully Jun 18 22:13:15.254526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d23108-4b6f-45b6-8ab3-02c23a999440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:15.260229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Flow 'volume_create_manager' (60809fa3-66bc-4c10-bdb2-a7f07a4d7863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:13:15.294058 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cec01557-ec49-4a11-a8d1-170969ba7a5d tempest-ServerRescueNegativeTestJSON-1217932637 None] Created volume successfully. Jun 18 22:13:25.302185 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:26.691001 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:13:26.706918 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:26.768126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:26.832969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:13:26.833725 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:13:26.851894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] deleting rbd volume volume-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:13:27.187037 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Created reservations ['5ca3498a-2a5d-4096-a04c-fe23e75b6392', 'fbe4670d-d9d7-4f82-9a6c-e7a1d0f81438', '82645999-17ac-499c-bfc2-f054819ae779', '436ddb01-13a8-4078-842c-7fe475e50e31'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:13:27.233202 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:27.266456 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:27.310249 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:13:27.320140 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Deleted volume successfully. Jun 18 22:13:27.343371 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-deb0f339-4b1c-423e-9fc1-39764260ac96 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b-delete_volume'" released by "delete_volume" :: held 0.649s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:13:27.897779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-1b01b938-d2cd-4134-a6f2-3145c57622ca-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:13:27.993533 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:28.063098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:13:28.063427 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Volume volume-1b01b938-d2cd-4134-a6f2-3145c57622ca is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:13:28.077937 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] deleting rbd volume volume-1b01b938-d2cd-4134-a6f2-3145c57622ca {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:13:28.387306 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Created reservations ['04578dd1-4144-4046-95e5-224facfd37d7', '52c1d686-0995-42d1-8388-d22aa8531cbc', 'eaad1c77-6ea3-4532-8e27-fa26021193ea', '74b047c4-f963-4ccd-99ae-0341873510ee'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:13:28.461362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:28.520919 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:28.594964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:13:28.599521 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Deleted volume successfully. Jun 18 22:13:28.619857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-d4796aea-9ce3-4d62-8905-f582ffbf0e9a tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-1b01b938-d2cd-4134-a6f2-3145c57622ca-delete_volume'" released by "delete_volume" :: held 0.722s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:13:29.194691 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-cf0825c5-efd0-466f-b40a-5de8da952467-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:13:29.265664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:29.389157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:13:29.401389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] deleting rbd volume volume-cf0825c5-efd0-466f-b40a-5de8da952467 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:13:29.939348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:13:29.988013 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] deleting parent snapshot volume-cf0825c5-efd0-466f-b40a-5de8da952467.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:13:30.504587 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] Created reservations ['1d14f6b1-d95f-4778-bd2f-517611de9faf', 'ddd05420-f172-4971-986a-9200e56347fd', '21e6ee96-b75f-4779-82ad-a241c2863aca', '669e7d69-b008-4b2c-a05f-3cd6d028d001'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:13:30.615139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:30.697165 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:30.763717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:13:30.771558 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] Deleted volume successfully. Jun 18 22:13:30.797791 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-522598ea-e080-4774-a443-8b716d7ef714 tempest-TaggedBootDevicesTest-1883771144 None] Lock "b'cinder-cf0825c5-efd0-466f-b40a-5de8da952467-delete_volume'" released by "delete_volume" :: held 1.603s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:13:47.278876 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:13:47.279633 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:47.317297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:47.352669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:13:54.274348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:13:54.299830 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Flow 'volume_create_manager' (bad23b44-33dd-45c0-9914-1528bc260869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:13:54.307233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a15880d-71e6-418f-b029-66775213b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.325443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a15880d-71e6-418f-b029-66775213b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1780837440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01bad54a-272a-4e26-871e-beb4a6d0498e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a129b1f88f4c4f97cc3a9f76ef47f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:13:54Z,use_quota=True,user_id='27c40405bf7547b4b1b896b142ea4156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.331793 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b52fa1-6f7b-4200-9128-899ee517fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.335886 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b52fa1-6f7b-4200-9128-899ee517fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.341148 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99032c9-b098-4c28-b84b-c8412461f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.345280 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99032c9-b098-4c28-b84b-c8412461f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01bad54a-272a-4e26-871e-beb4a6d0498e', 'volume_name': 'volume-01bad54a-272a-4e26-871e-beb4a6d0498e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.350260 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab07c4a-1a85-4447-a7ea-de37e1758408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.355193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab07c4a-1a85-4447-a7ea-de37e1758408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.360988 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b86d17-44fb-4cbf-b904-8618bb94a783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.362278 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Volume 01bad54a-272a-4e26-871e-beb4a6d0498e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01bad54a-272a-4e26-871e-beb4a6d0498e', 'volume_size': 1} Jun 18 22:13:54.362695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] creating volume 'volume-01bad54a-272a-4e26-871e-beb4a6d0498e' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:13:54.365117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:13:54.501778 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:13:54.502742 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:13:54.506787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b86d17-44fb-4cbf-b904-8618bb94a783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01bad54a-272a-4e26-871e-beb4a6d0498e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.516554 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d7acee-c5c2-412f-a40d-bde9626ee1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:13:54.529386 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Volume volume-01bad54a-272a-4e26-871e-beb4a6d0498e (01bad54a-272a-4e26-871e-beb4a6d0498e): created successfully Jun 18 22:13:54.535279 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d7acee-c5c2-412f-a40d-bde9626ee1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:13:54.542058 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Flow 'volume_create_manager' (bad23b44-33dd-45c0-9914-1528bc260869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:13:54.555377 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-64045f58-f2cd-448d-ab8f-50926ddf8a13 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Created volume successfully. Jun 18 22:13:56.444298 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=46,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:56.459704 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-018fb8fc-b681-4255-8ebd-30be86b98812 req-2c28e94d-6619-44ae-bc4d-7640814ab2b4 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:13:58.521183 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-018fb8fc-b681-4255-8ebd-30be86b98812 req-2c28e94d-6619-44ae-bc4d-7640814ab2b4 tempest-AttachSCSIVolumeTestJSON-1926732602 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.064s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:13:58.522655 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-018fb8fc-b681-4255-8ebd-30be86b98812 req-2c28e94d-6619-44ae-bc4d-7640814ab2b4 tempest-AttachSCSIVolumeTestJSON-1926732602 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01bad54a-272a-4e26-871e-beb4a6d0498e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '01bad54a-272a-4e26-871e-beb4a6d0498e', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:13:58.527834 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=47,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:58.612187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-018fb8fc-b681-4255-8ebd-30be86b98812 req-2c28e94d-6619-44ae-bc4d-7640814ab2b4 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Connection info returned from driver {'name': 'volumes/volume-01bad54a-272a-4e26-871e-beb4a6d0498e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01bad54a-272a-4e26-871e-beb4a6d0498e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '37ea9efb-b60b-414a-b691-5b6e6aba9aa3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:13:58.797699 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-018fb8fc-b681-4255-8ebd-30be86b98812 req-2c28e94d-6619-44ae-bc4d-7640814ab2b4 tempest-AttachSCSIVolumeTestJSON-1926732602 None] attachment_update completed successfully. Jun 18 22:14:02.086525 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-8413345a-6fef-4431-b8dd-c803fdea328b req-d95de3de-069b-4737-abfd-d88d19912c1a tempest-AttachSCSIVolumeTestJSON-1926732602 None] Terminate volume connection completed successfully. Jun 18 22:14:02.087256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-8413345a-6fef-4431-b8dd-c803fdea328b req-d95de3de-069b-4737-abfd-d88d19912c1a tempest-AttachSCSIVolumeTestJSON-1926732602 None] Deleting attachment 37ea9efb-b60b-414a-b691-5b6e6aba9aa3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:14:11.126127 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Lock "b'cinder-01bad54a-272a-4e26-871e-beb4a6d0498e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:14:11.200084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:14:11.299881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:14:11.300452 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Volume volume-01bad54a-272a-4e26-871e-beb4a6d0498e is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:14:11.328050 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] deleting rbd volume volume-01bad54a-272a-4e26-871e-beb4a6d0498e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:14:11.743952 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Created reservations ['0f263049-51a2-4845-a78d-24b650ac28bd', '2478b5c7-bce9-41c0-b405-b6460c98d523', 'df5f3d8f-160f-43a5-a9ec-184972054a02', 'd5947b11-f135-4afe-8ad3-15b6976d6383'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:14:11.861976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:14:11.974128 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:14:12.066966 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:14:12.079241 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Deleted volume successfully. Jun 18 22:14:12.116459 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-981d4d8d-edc1-414d-948a-f2f1486a0386 tempest-AttachSCSIVolumeTestJSON-1926732602 None] Lock "b'cinder-01bad54a-272a-4e26-871e-beb4a6d0498e-delete_volume'" released by "delete_volume" :: held 0.991s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:14:29.407163 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=28,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:29.407795 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=27,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:47.284247 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:14:47.286859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:14:47.394119 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:14:47.494038 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:14:49.414139 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:07.966478 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:07.969742 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 req-9bdac45f-1c13-4f1b-ae19-2084a58a78b7 tempest-ServerRescueNegativeTestJSON-1217932637 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:15:09.685261 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 req-9bdac45f-1c13-4f1b-ae19-2084a58a78b7 tempest-ServerRescueNegativeTestJSON-1217932637 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.715s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:15:09.686181 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 req-9bdac45f-1c13-4f1b-ae19-2084a58a78b7 tempest-ServerRescueNegativeTestJSON-1217932637 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8d48035a-208e-4c79-b4c3-8bbff016c991', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '8d48035a-208e-4c79-b4c3-8bbff016c991', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:15:09.736938 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 req-9bdac45f-1c13-4f1b-ae19-2084a58a78b7 tempest-ServerRescueNegativeTestJSON-1217932637 None] Connection info returned from driver {'name': 'volumes/volume-8d48035a-208e-4c79-b4c3-8bbff016c991', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8d48035a-208e-4c79-b4c3-8bbff016c991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f35de5e5-bcd4-42ba-a998-d05f0ba1c7d3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:15:09.864429 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 req-9bdac45f-1c13-4f1b-ae19-2084a58a78b7 tempest-ServerRescueNegativeTestJSON-1217932637 None] attachment_update completed successfully. Jun 18 22:15:19.865778 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:29.421256 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:47.276959 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:15:47.278797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:15:47.323256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:15:47.389915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:15:49.419808 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:02.496403 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:16:02.539573 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Flow 'volume_create_manager' (9826b8cb-f6b7-4bde-9df1-311c19cdbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:16:02.550240 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08c058-c846-4387-bf05-e800f43183a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.576823 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08c058-c846-4387-bf05-e800f43183a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-972293183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39c5459a57f74e4397551140b9b38726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:16:02Z,use_quota=True,user_id='04ff72bd5e02459293b6ecf2e67ce8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.589216 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2bfd54-4a57-495d-962c-88d538deba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.593321 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2bfd54-4a57-495d-962c-88d538deba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.603411 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3a966-2e95-4a20-ac4b-62735df72be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.610610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3a966-2e95-4a20-ac4b-62735df72be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1', 'volume_name': 'volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.617554 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b4d174-7817-4eff-8203-d739b4c84c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.624827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b4d174-7817-4eff-8203-d739b4c84c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.631204 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9385e3-798b-4bb7-a9fb-baca9d0bbad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.632593 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Volume 7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1', 'volume_size': 1} Jun 18 22:16:02.633120 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] creating volume 'volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:16:02.634231 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:02.754246 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:16:02.758041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:16:02.763591 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9385e3-798b-4bb7-a9fb-baca9d0bbad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.777727 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f5b3f-baab-4412-9785-f0ea667d2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:16:02.792407 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Volume volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1 (7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1): created successfully Jun 18 22:16:02.811616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f5b3f-baab-4412-9785-f0ea667d2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:16:02.827485 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Flow 'volume_create_manager' (9826b8cb-f6b7-4bde-9df1-311c19cdbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:16:02.838711 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-81b06986-f390-428f-9e02-3b7bd7b8d3fb tempest-SnapshotsActionsTest-1128769464 None] Created volume successfully. Jun 18 22:16:03.897779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb6de37e-6803-4e87-b8fc-c15b360f61ad tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:04.576498 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cb6de37e-6803-4e87-b8fc-c15b360f61ad tempest-SnapshotsActionsTest-1128769464 None] Create snapshot completed successfully Jun 18 22:16:05.835238 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-619b95c0-10c4-4301-94c1-6238c5f14ba2 tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:06.547347 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-619b95c0-10c4-4301-94c1-6238c5f14ba2 tempest-SnapshotsActionsTest-1128769464 None] Create snapshot completed successfully Jun 18 22:16:07.182324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-00781ad2-0781-4025-833e-e638c38bc5f6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:07.185480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:07.643390 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:16:07.703602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] Created reservations ['3c2f414b-b177-4259-829c-fd343b10df90', '43e6730c-b228-41f7-9e3b-898a96bdf141', '4706724b-9075-4a48-9216-9e140270c585', '827858ac-ddf8-435c-a9c9-6d367923f1f0'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:07.809701 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] Delete snapshot completed successfully. Jun 18 22:16:07.817356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-163b01f1-2cd3-46cf-9f02-2894d49ff989 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-00781ad2-0781-4025-833e-e638c38bc5f6-delete_snapshot'" released by "delete_snapshot" :: held 0.635s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:08.762447 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-30f93a78-8ac5-4954-b744-be358352601e tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:09.640207 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=30,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:09.645568 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-30f93a78-8ac5-4954-b744-be358352601e tempest-SnapshotsActionsTest-1128769464 None] Create snapshot completed successfully Jun 18 22:16:10.152511 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-052feaa3-2787-44b0-9363-eeb6eb49f7f5 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-868a8107-bb47-4419-90d8-118d91fcd60c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:10.153980 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-052feaa3-2787-44b0-9363-eeb6eb49f7f5 tempest-SnapshotsActionsTest-626602666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:10.748374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-052feaa3-2787-44b0-9363-eeb6eb49f7f5 tempest-SnapshotsActionsTest-626602666 None] Created reservations ['d1fa57e1-2341-480f-9b02-b8eb3be9278b', 'cbe3740e-28c6-4e79-94b2-6f6e04ee5383', '5e564b81-6aa2-4e10-b7b5-e381aa543016', '42b94bc7-7812-40a3-a25b-2fa753036c01'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:10.821461 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-052feaa3-2787-44b0-9363-eeb6eb49f7f5 tempest-SnapshotsActionsTest-626602666 None] Delete snapshot completed successfully. Jun 18 22:16:10.827675 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-052feaa3-2787-44b0-9363-eeb6eb49f7f5 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-868a8107-bb47-4419-90d8-118d91fcd60c-delete_snapshot'" released by "delete_snapshot" :: held 0.676s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:11.875547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-592c3ecd-b6fa-46d2-ae50-beef045eebdc tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:12.878977 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-592c3ecd-b6fa-46d2-ae50-beef045eebdc tempest-SnapshotsActionsTest-1128769464 None] Create snapshot completed successfully Jun 18 22:16:14.354782 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d7564f8-31f1-4eb6-bc4e-d9681faa13d7 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-64f495ce-1aa2-4dfa-bd89-13b56ac83acb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:14.384105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d7564f8-31f1-4eb6-bc4e-d9681faa13d7 tempest-SnapshotsActionsTest-626602666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:15.112758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9d7564f8-31f1-4eb6-bc4e-d9681faa13d7 tempest-SnapshotsActionsTest-626602666 None] Created reservations ['4b6591a3-a8d4-4f33-9cab-697f447b5fb9', '27105990-2bec-4818-844b-ddb4afcd16a8', '4e47c4fd-6811-48e7-9050-f842659bfd90', '2390ec97-d989-427e-8e21-a01c7c6fab54'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:15.215840 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9d7564f8-31f1-4eb6-bc4e-d9681faa13d7 tempest-SnapshotsActionsTest-626602666 None] Delete snapshot completed successfully. Jun 18 22:16:15.220679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d7564f8-31f1-4eb6-bc4e-d9681faa13d7 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-64f495ce-1aa2-4dfa-bd89-13b56ac83acb-delete_snapshot'" released by "delete_snapshot" :: held 0.866s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:16.240317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-40edd148-74d8-4fbc-925e-bc5a599f374d tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:17.021882 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-40edd148-74d8-4fbc-925e-bc5a599f374d tempest-SnapshotsActionsTest-1128769464 None] Create snapshot completed successfully Jun 18 22:16:17.541089 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7e309e81-094b-4bcb-9bd4-bca3c0e9c862 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-93d78f49-f782-4a94-be4a-4a7c3730bf3e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:17.545774 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e309e81-094b-4bcb-9bd4-bca3c0e9c862 tempest-SnapshotsActionsTest-626602666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:17.966545 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:18.000514 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-7e309e81-094b-4bcb-9bd4-bca3c0e9c862 tempest-SnapshotsActionsTest-626602666 None] Created reservations ['15fe3d9d-a898-427f-b925-53e000014b4c', '5b477f22-defd-4a05-82dc-7d795a6ab5ad', '2dde928b-e5a7-427f-94ff-83db7fa67b17', '0bb80605-ad17-4feb-a418-c0320b6c8ac8'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:18.093439 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7e309e81-094b-4bcb-9bd4-bca3c0e9c862 tempest-SnapshotsActionsTest-626602666 None] Delete snapshot completed successfully. Jun 18 22:16:18.102752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7e309e81-094b-4bcb-9bd4-bca3c0e9c862 tempest-SnapshotsActionsTest-626602666 None] Lock "b'cinder-93d78f49-f782-4a94-be4a-4a7c3730bf3e-delete_snapshot'" released by "delete_snapshot" :: held 0.564s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:19.662002 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9a90199d-60a7-42eb-92ce-8c5b894f5560 tempest-SnapshotsActionsTest-1128769464 None] Lock "b'cinder-45b69420-7acb-4edb-8668-8e1f9f469c45-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.055s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:19.674941 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a90199d-60a7-42eb-92ce-8c5b894f5560 tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:20.292017 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9a90199d-60a7-42eb-92ce-8c5b894f5560 tempest-SnapshotsActionsTest-1128769464 None] Created reservations ['b8271939-1867-4247-b236-8fa9846454e2', '7d6d0177-144e-4d90-9b10-cb5a0062a5f4', '2c313581-d4a6-4463-ab55-62597e2e6199', 'c03edc71-8a6f-4b7e-aa91-6afcc2327c82'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:20.391005 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9a90199d-60a7-42eb-92ce-8c5b894f5560 tempest-SnapshotsActionsTest-1128769464 None] Delete snapshot completed successfully. Jun 18 22:16:20.406568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9a90199d-60a7-42eb-92ce-8c5b894f5560 tempest-SnapshotsActionsTest-1128769464 None] Lock "b'cinder-45b69420-7acb-4edb-8668-8e1f9f469c45-delete_snapshot'" released by "delete_snapshot" :: held 0.747s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:20.937843 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Lock "b'cinder-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:16:21.022634 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:21.143081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:16:21.143573 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Volume volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:16:21.157463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] deleting rbd volume volume-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:16:21.705406 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=60,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:21.712958 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Created reservations ['2d78b6e0-b2ea-4e4e-8c54-801bec6760af', 'f1ff765b-b141-4ecf-b7a9-b102989c0623', 'abdedad8-e131-46bb-8b2e-8ca33c583912', 'd233c708-f705-4f5f-97c6-b61062ac00a5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:16:21.823633 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:21.918441 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:22.013694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:16:22.019906 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Deleted volume successfully. Jun 18 22:16:22.046516 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-71fb1081-b1cd-44d2-a331-a23fadfb060a tempest-SnapshotsActionsTest-1128769464 None] Lock "b'cinder-7eee5024-7ec3-42f7-9d18-1ded1ce9f0a1-delete_volume'" released by "delete_volume" :: held 1.109s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:16:39.434560 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:DELETE=1,cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:43.265958 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 req-5dfc24cf-3b8e-452b-8fa3-ecb83e14962c tempest-ServerRescueNegativeTestJSON-1217932637 None] Terminate volume connection completed successfully. Jun 18 22:16:43.268633 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 req-5dfc24cf-3b8e-452b-8fa3-ecb83e14962c tempest-ServerRescueNegativeTestJSON-1217932637 None] Deleting attachment f35de5e5-bcd4-42ba-a998-d05f0ba1c7d3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:16:47.274981 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:16:47.276297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:47.340134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:16:47.379410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:16:49.421103 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=34,cinder:UPDATE=21,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:00.199775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Lock "b'cinder-8d48035a-208e-4c79-b4c3-8bbff016c991-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:00.322619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:00.400502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:00.400939 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume volume-8d48035a-208e-4c79-b4c3-8bbff016c991 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:00.410602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] deleting rbd volume volume-8d48035a-208e-4c79-b4c3-8bbff016c991 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:00.825923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Created reservations ['02322066-ce15-4bb3-8a26-8a38368966f0', '180b5d30-101a-4bc6-bad0-396d8f00b1d2', 'bb88a4f5-c271-4e5d-aead-790732314be8', 'e0be0c88-11cb-4d0e-b0ca-70b3f32c495f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:00.900640 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:00.960138 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:01.014233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:01.021787 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Deleted volume successfully. Jun 18 22:17:01.040132 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-64f691ae-e381-4da4-87bf-59d990bd3936 tempest-ServerRescueNegativeTestJSON-1217932637 None] Lock "b'cinder-8d48035a-208e-4c79-b4c3-8bbff016c991-delete_volume'" released by "delete_volume" :: held 0.842s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:01.478869 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Lock "b'cinder-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:01.568425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:01.684234 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:01.685519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Volume volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:01.704981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] deleting rbd volume volume-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:02.111568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Created reservations ['cf19eb8a-8f45-471e-9233-9a2f8ade786d', '81465bbb-5101-4a51-940e-73e5e047291e', 'ff9476f5-5744-4930-9d3b-449c998da11e', '5c9db099-b820-4f58-b72b-5ede73e48801'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:02.212647 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:02.279005 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:02.333381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:02.359415 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Deleted volume successfully. Jun 18 22:17:02.407020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8db43627-de00-47b8-ab62-4eec9888b776 tempest-ServerRescueNegativeTestJSON-1217932637 None] Lock "b'cinder-c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8-delete_volume'" released by "delete_volume" :: held 0.928s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:02.410667 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:17:02.459637 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Flow 'volume_create_manager' (8a42778a-c97b-4f55-9a81-4d5f2cd15a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:02.471240 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d59700d-9134-4d58-a6ed-0300c3ea7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:02.493135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d59700d-9134-4d58-a6ed-0300c3ea7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-521115776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=623d0407-fe0c-4446-a2bc-e7764387d344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4aec54b8e64552972b915826bc7eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:17:02Z,use_quota=True,user_id='de35eef08935474a8dc6e980cbd07b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:02.502437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1689e1-f0d5-4f62-95eb-352800917c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:02.510694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1689e1-f0d5-4f62-95eb-352800917c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:02.522228 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7369025-b4ce-4fbc-bc53-2d0849e33de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:02.662468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7369025-b4ce-4fbc-bc53-2d0849e33de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '623d0407-fe0c-4446-a2bc-e7764387d344', 'volume_name': 'volume-623d0407-fe0c-4446-a2bc-e7764387d344', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:02.668364 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291e93c4-6628-4cca-8045-aa55d3231ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:02.673561 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291e93c4-6628-4cca-8045-aa55d3231ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:02.679496 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511e3a6e-1efa-4a37-bca3-539604e75d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:02.681118 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Volume 623d0407-fe0c-4446-a2bc-e7764387d344: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-623d0407-fe0c-4446-a2bc-e7764387d344', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:17:02.681809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Cloning 623d0407-fe0c-4446-a2bc-e7764387d344 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:17:02.692540 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:02.714185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 17, 2, 698110)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:17:02.714588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:17:02.714996 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:17:02.722747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:02.724195 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:17:02.732184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 17, 2, 729384)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:17:02.733162 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:17:02.733554 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:17:02.755269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:02.858381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] creating snapshot='volume-623d0407-fe0c-4446-a2bc-e7764387d344.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:17:03.588010 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-623d0407-fe0c-4446-a2bc-e7764387d344.clone_snap' to 'volume-623d0407-fe0c-4446-a2bc-e7764387d344' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:17:03.830641 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:03.832265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:17:03.833723 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:17:03.863668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:17:03.864961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Marking volume 623d0407-fe0c-4446-a2bc-e7764387d344 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:17:03.879574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 623d0407-fe0c-4446-a2bc-e7764387d344. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:17:03.883650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Creating volume glance metadata for volume 623d0407-fe0c-4446-a2bc-e7764387d344 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:17:04.096771 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511e3a6e-1efa-4a37-bca3-539604e75d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623d0407-fe0c-4446-a2bc-e7764387d344', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:04.122203 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ba403-910a-4966-9979-8c77f5063a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:04.158514 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Volume volume-623d0407-fe0c-4446-a2bc-e7764387d344 (623d0407-fe0c-4446-a2bc-e7764387d344): created successfully Jun 18 22:17:04.167572 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40ba403-910a-4966-9979-8c77f5063a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:04.183039 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Flow 'volume_create_manager' (8a42778a-c97b-4f55-9a81-4d5f2cd15a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:04.229908 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-adab3cec-028a-4dd3-92f9-4e880ec49d47 tempest-VolumesImageMetadata-1406817094 None] Created volume successfully. Jun 18 22:17:06.083063 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] Lock "b'cinder-623d0407-fe0c-4446-a2bc-e7764387d344-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:06.175919 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:06.369331 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:06.391628 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] deleting rbd volume volume-623d0407-fe0c-4446-a2bc-e7764387d344 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:06.740560 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:17:06.781249 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] deleting parent snapshot volume-623d0407-fe0c-4446-a2bc-e7764387d344.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:17:07.797975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] Created reservations ['8cf61b8f-bb46-4b43-8da7-04d00d31728e', '565260df-c0a4-4df9-8774-63972fd3a8eb', 'a0849197-7bfd-4a07-b614-745eb24e7fd2', 'fb8d9275-a184-483d-9079-e6beab45c3fd'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:07.898183 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=54,cinder:UPDATE=26,cinder:INSERT=18,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:07.907073 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:08.081876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:08.211614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:08.220668 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] Deleted volume successfully. Jun 18 22:17:08.251144 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-087c76a3-b20b-4c79-b523-f81d9db7167a tempest-VolumesImageMetadata-1406817094 None] Lock "b'cinder-623d0407-fe0c-4446-a2bc-e7764387d344-delete_volume'" released by "delete_volume" :: held 2.167s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:13.758614 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:13.781385 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:17:13.811342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Flow 'volume_create_manager' (a886f9a9-e712-4cce-b4a4-0d4dfff9cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:13.819401 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e75773-81a7-421d-b7d5-45e61d7858c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:13.841555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e75773-81a7-421d-b7d5-45e61d7858c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1775648302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=87f19cd9-dd27-4175-bea9-8d01e9bb11b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41092816c6b441fb67de74cdad1a54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:17:14Z,use_quota=True,user_id='3a1ed7ee7f5d4673a19a26073b505bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:13.848618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51766eb9-2bb2-4747-9dae-1cba8082782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:13.868363 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51766eb9-2bb2-4747-9dae-1cba8082782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:13.887256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173501ff-7c61-46b3-bee5-166e6165df05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:13.892191 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173501ff-7c61-46b3-bee5-166e6165df05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f19cd9-dd27-4175-bea9-8d01e9bb11b7', 'volume_name': 'volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:13.898233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9de1f16-4b0f-47d3-a443-193478da42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:13.904641 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9de1f16-4b0f-47d3-a443-193478da42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:13.916447 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51cc1ae-74e2-4118-b0be-daa2c4cdc203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:13.919318 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Volume 87f19cd9-dd27-4175-bea9-8d01e9bb11b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7', 'volume_size': 1} Jun 18 22:17:13.919976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] creating volume 'volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:17:13.920983 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:14.098615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:17:14.099286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:17:14.103162 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51cc1ae-74e2-4118-b0be-daa2c4cdc203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:14.109880 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0778d53e-1cbc-467d-b5e7-3d4f1330fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:14.131538 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Volume volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7 (87f19cd9-dd27-4175-bea9-8d01e9bb11b7): created successfully Jun 18 22:17:14.137465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0778d53e-1cbc-467d-b5e7-3d4f1330fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:14.143867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Flow 'volume_create_manager' (a886f9a9-e712-4cce-b4a4-0d4dfff9cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:14.159103 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c88fedb1-dede-41d9-9566-97f1f7abd5cb tempest-SnapshotMetadataTestJSON-1245029197 None] Created volume successfully. Jun 18 22:17:15.151375 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7cd3c900-fae7-430e-98d3-256c994f7d2f tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:16.157426 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7cd3c900-fae7-430e-98d3-256c994f7d2f tempest-SnapshotMetadataTestJSON-1245029197 None] Create snapshot completed successfully Jun 18 22:17:18.518781 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4d236498-751e-49dc-b6e5-29b7bdf2ca49 tempest-SnapshotMetadataTestJSON-1245029197 None] Lock "b'cinder-d1ceb54a-06df-4b9c-88c8-721126a5cca5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:18.526776 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d236498-751e-49dc-b6e5-29b7bdf2ca49 tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:19.302776 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4d236498-751e-49dc-b6e5-29b7bdf2ca49 tempest-SnapshotMetadataTestJSON-1245029197 None] Created reservations ['d7c263a0-b6da-424b-b481-5f3a9144fa97', 'd9ab5938-1aa1-44d3-9fe7-9324fb6d432c', 'fa46955d-7271-41b3-8c78-c996563f0ae2', 'e9c43e19-92b5-44ad-9264-912f71630567'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:19.437637 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4d236498-751e-49dc-b6e5-29b7bdf2ca49 tempest-SnapshotMetadataTestJSON-1245029197 None] Delete snapshot completed successfully. Jun 18 22:17:19.444638 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4d236498-751e-49dc-b6e5-29b7bdf2ca49 tempest-SnapshotMetadataTestJSON-1245029197 None] Lock "b'cinder-d1ceb54a-06df-4b9c-88c8-721126a5cca5-delete_snapshot'" released by "delete_snapshot" :: held 0.927s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:19.764361 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Lock "b'cinder-87f19cd9-dd27-4175-bea9-8d01e9bb11b7-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:19.877446 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:19.981169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:19.981716 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Volume volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:19.995145 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] deleting rbd volume volume-87f19cd9-dd27-4175-bea9-8d01e9bb11b7 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:20.516179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Created reservations ['b1a609f2-2c52-4895-a922-4a4dd432629e', '8418e9e9-56ad-460a-85e9-4a24929e8f47', '5252e265-74e2-4b23-89a2-29b3fd24e5ca', '5f1ea3d8-5f2c-4572-a964-1538e66feca4'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:20.621673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:20.721067 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:20.809817 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:20.817352 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Deleted volume successfully. Jun 18 22:17:20.840411 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-04fbc8f3-91c6-4406-bc7e-b542f111b41b tempest-SnapshotMetadataTestJSON-1245029197 None] Lock "b'cinder-87f19cd9-dd27-4175-bea9-8d01e9bb11b7-delete_volume'" released by "delete_volume" :: held 1.079s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:25.854779 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-352f1019-0cb5-45c6-b7c5-a3fa5c9191d5 tempest-TaggedBootDevicesTest_v242-1622454662 None] Terminate volume connection completed successfully. Jun 18 22:17:25.855566 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-352f1019-0cb5-45c6-b7c5-a3fa5c9191d5 tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleting attachment 30aeb351-a734-4560-bb5f-771207dcf6cc. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:17:26.145794 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-696b0bb3-0d6a-4062-8133-7b4f12791715 tempest-TaggedBootDevicesTest_v242-1622454662 None] Terminate volume connection completed successfully. Jun 18 22:17:26.146936 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-696b0bb3-0d6a-4062-8133-7b4f12791715 tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleting attachment 5dffe2c8-cab5-4360-ba21-ae5d9057a1fa. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:17:26.529481 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-d414a065-6da4-45d6-a1cc-3c44e0f07ee4 tempest-TaggedBootDevicesTest_v242-1622454662 None] Terminate volume connection completed successfully. Jun 18 22:17:26.559198 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-f31e30c9-8b39-4922-b0d3-4aea766fded7 req-d414a065-6da4-45d6-a1cc-3c44e0f07ee4 tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleting attachment c9fd9fed-d508-4245-a57f-0933fc233188. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:17:30.864166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:17:30.891707 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Flow 'volume_create_manager' (d4131749-26e5-471e-a440-ef121a8a0763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:30.902404 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80016e-73c5-4bf6-8622-0f9660b6cb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:30.951701 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80016e-73c5-4bf6-8622-0f9660b6cb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-355918518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7a24b02-4329-4930-bd02-a75f095ac0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b58cb4c698443589ba9e0f6444a125e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:17:31Z,use_quota=True,user_id='7a2c9649eee14666bfcbeea55e2fd98d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:30.957044 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ef021-687b-4491-8b61-a98249073b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:30.961420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ef021-687b-4491-8b61-a98249073b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:30.966548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88498c1a-f82a-4e27-9981-b6c5db0400c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:30.970574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88498c1a-f82a-4e27-9981-b6c5db0400c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a24b02-4329-4930-bd02-a75f095ac0d3', 'volume_name': 'volume-c7a24b02-4329-4930-bd02-a75f095ac0d3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:30.994844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1950c7-98ae-41f7-8033-f66521f4bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:31.002733 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1950c7-98ae-41f7-8033-f66521f4bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:31.014546 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde05e19-da4b-4660-a529-18a6ec5eca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:31.016241 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Volume c7a24b02-4329-4930-bd02-a75f095ac0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a24b02-4329-4930-bd02-a75f095ac0d3', 'volume_size': 1} Jun 18 22:17:31.016960 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] creating volume 'volume-c7a24b02-4329-4930-bd02-a75f095ac0d3' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:17:31.018953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:31.156885 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:17:31.157533 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:17:31.161330 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde05e19-da4b-4660-a529-18a6ec5eca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a24b02-4329-4930-bd02-a75f095ac0d3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:31.166294 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb16aadf-afae-4a10-b6f3-7a6fbbccf347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:31.207753 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Volume volume-c7a24b02-4329-4930-bd02-a75f095ac0d3 (c7a24b02-4329-4930-bd02-a75f095ac0d3): created successfully Jun 18 22:17:31.211918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb16aadf-afae-4a10-b6f3-7a6fbbccf347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:31.231997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Flow 'volume_create_manager' (d4131749-26e5-471e-a440-ef121a8a0763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:31.259913 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6b6dd5fc-00a7-448d-8376-6ce95c27fce1 tempest-AbsoluteLimitsTests-28428430 None] Created volume successfully. Jun 18 22:17:32.097881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Lock "b'cinder-c7a24b02-4329-4930-bd02-a75f095ac0d3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:32.258431 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:32.412342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:32.412766 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Volume volume-c7a24b02-4329-4930-bd02-a75f095ac0d3 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:32.425237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] deleting rbd volume volume-c7a24b02-4329-4930-bd02-a75f095ac0d3 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:32.946679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Created reservations ['43fe19ae-28f2-4b53-841f-462ebd23f2cc', '1d8ef935-8e69-450f-84a0-ab1c2f74d779', '4ce19229-8418-4865-8b89-bbb2ae3e4eea', '94d91c55-0654-46d0-8f77-fc5f5707b397'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:33.056991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:33.169803 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:33.291088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:33.308297 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Deleted volume successfully. Jun 18 22:17:33.352631 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-998941c1-0ef6-4a87-a599-b2e2b4d3a966 tempest-AbsoluteLimitsTests-28428430 None] Lock "b'cinder-c7a24b02-4329-4930-bd02-a75f095ac0d3-delete_volume'" released by "delete_volume" :: held 1.256s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:39.416307 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:41.973944 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:17:41.998509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Flow 'volume_create_manager' (4753fbd9-8429-4aa8-a069-29b7887ab05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:42.007341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde46514-0e4e-47e6-9788-d483b1a7cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.032508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde46514-0e4e-47e6-9788-d483b1a7cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1290247549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a004fc56-bdef-4ab3-a24a-7efa09d68825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b9d140d26640cca3a442c2b17e0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:17:42Z,use_quota=True,user_id='16c9d7373adb43d6b452cf4f8d007637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.043335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eac53fc-f865-4427-b6f5-8ad3817d19dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.050169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eac53fc-f865-4427-b6f5-8ad3817d19dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.060239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84eadb2-3b72-40f1-af24-37a87f80d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.065179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84eadb2-3b72-40f1-af24-37a87f80d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a004fc56-bdef-4ab3-a24a-7efa09d68825', 'volume_name': 'volume-a004fc56-bdef-4ab3-a24a-7efa09d68825', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.070797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d752529-6e73-4c1c-ba28-f988329c9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.077267 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d752529-6e73-4c1c-ba28-f988329c9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.083368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cac950-726c-48c6-94f0-106318020fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.085553 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Volume a004fc56-bdef-4ab3-a24a-7efa09d68825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a004fc56-bdef-4ab3-a24a-7efa09d68825', 'volume_size': 1} Jun 18 22:17:42.086193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] creating volume 'volume-a004fc56-bdef-4ab3-a24a-7efa09d68825' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:17:42.088337 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:42.201863 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:17:42.202159 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:17:42.206376 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cac950-726c-48c6-94f0-106318020fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a004fc56-bdef-4ab3-a24a-7efa09d68825', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.213006 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ffc9ae-2c95-49e8-84b4-f4cc2f991430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:42.233846 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Volume volume-a004fc56-bdef-4ab3-a24a-7efa09d68825 (a004fc56-bdef-4ab3-a24a-7efa09d68825): created successfully Jun 18 22:17:42.238438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ffc9ae-2c95-49e8-84b4-f4cc2f991430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:42.245513 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Flow 'volume_create_manager' (4753fbd9-8429-4aa8-a069-29b7887ab05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:42.257403 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8e48b7fa-26a4-4a5a-a824-a8588d212898 tempest-VolumesDeleteCascade-1381908502 None] Created volume successfully. Jun 18 22:17:43.524452 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=64,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=11 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:43.539094 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9174639a-579f-4409-a28f-06fcf62c729a tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:44.580212 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9174639a-579f-4409-a28f-06fcf62c729a tempest-VolumesDeleteCascade-1381908502 None] Create snapshot completed successfully Jun 18 22:17:46.094156 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-60b71ffd-4bb1-4152-9668-62ac7809bea0 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:46.617493 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-60b71ffd-4bb1-4152-9668-62ac7809bea0 tempest-VolumesDeleteCascade-1381908502 None] Create snapshot completed successfully Jun 18 22:17:46.913545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-312a3580-badc-4fa9-b41c-122707532350-delete_volume'" acquired by "delete_volume" :: waited 0.081s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:47.035383 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:47.142883 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:47.143650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-312a3580-badc-4fa9-b41c-122707532350 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:47.162130 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] deleting rbd volume volume-312a3580-badc-4fa9-b41c-122707532350 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:47.275523 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:17:47.276344 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:47.340480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:47.427831 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:47.455348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-a004fc56-bdef-4ab3-a24a-7efa09d68825-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:47.532672 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Performing cascade delete. {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:968}} Jun 18 22:17:47.612184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-32215fee-4981-411b-9201-3885b9e53387-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.044s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:47.650976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:47.758926 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Created reservations ['5fc2d8aa-3fb8-44a1-8ff4-b8a0d352e030', 'cd7c8871-d3ee-4b71-ae6d-13b920db6f0c', 'c8e8a879-524a-4dba-ab2a-227f68b442aa', 'a603c9aa-3164-4b4e-9961-8eed8eeb988b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:47.862087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:47.944070 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:48.024284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:48.029331 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleted volume successfully. Jun 18 22:17:48.056362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8fcb5f7a-3070-4d71-9008-d98c7ebdf019 tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-312a3580-badc-4fa9-b41c-122707532350-delete_volume'" released by "delete_volume" :: held 1.143s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:48.177014 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:48.243016 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:48.339887 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:48.340519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Volume volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:48.350997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] deleting rbd volume volume-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:48.794508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Created reservations ['eabc44c9-7685-4527-834b-8873b75ec169', 'fae29959-665a-4826-970c-dc2a1cecf4cb', '77430b8d-d2a0-4ce1-9a66-5f21e78adef2', '34d53624-eb5a-4782-b9bb-9dc4eef4702e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:48.989805 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Delete snapshot completed successfully. Jun 18 22:17:49.002164 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-32215fee-4981-411b-9201-3885b9e53387-delete_snapshot'" released by "delete_snapshot" :: held 1.390s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:49.005752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Created reservations ['7cd65c06-8940-4b27-b293-12728b301bf5', '3cf9f281-8da2-4215-a48c-e11424d3294e', '44c4f81d-e90b-4338-8b4a-42f19b716efe', 'df5ea252-b17e-4c1b-ae6f-0d19cec72836'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:49.026317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-fdd81b46-44ad-44b3-9788-f35d01a246a2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:49.072666 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:49.163922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:49.206273 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:49.249067 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:49.255676 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleted volume successfully. Jun 18 22:17:49.273449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-87236905-8bfe-454b-a31e-770dab77826b tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b-delete_volume'" released by "delete_volume" :: held 1.096s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:49.375979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-df050525-1359-4e57-a0a7-5bfc9b675988-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:17:49.430076 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:49.525596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:49.537146 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] deleting rbd volume volume-df050525-1359-4e57-a0a7-5bfc9b675988 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:49.929527 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:17:49.975229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] deleting parent snapshot volume-df050525-1359-4e57-a0a7-5bfc9b675988.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:17:51.211749 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=63,cinder:UPDATE=24,cinder:DELETE=5,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:51.292003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] Created reservations ['b6c7c260-aa89-451f-a04b-139bcfe3d7c5', '92ef5ff5-84e2-40bf-964a-a68770a7099b', '60075440-b39f-4527-a2ad-aebc885550d1', '457bfd2d-9384-4fe5-b205-77e1602c365b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:51.320028 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=59,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:51.363786 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Created reservations ['a053f973-e1c6-4e6d-87b5-b81c98c968ea', '4e3a8a89-78a4-4028-bcf9-84929129c8a9', '77030a7f-8bc0-4588-8c44-0a7ca706dda8', 'b82f3fc3-f8b8-4fff-ab54-19cbd4cf55b6'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:51.398979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:51.442645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:51.493295 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:51.503627 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] Deleted volume successfully. Jun 18 22:17:51.533209 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ce164d0d-2108-423d-83b8-3cc2515c4698 tempest-TaggedBootDevicesTest_v242-1622454662 None] Lock "b'cinder-df050525-1359-4e57-a0a7-5bfc9b675988-delete_volume'" released by "delete_volume" :: held 2.157s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:51.539600 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Delete snapshot completed successfully. Jun 18 22:17:51.550511 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-fdd81b46-44ad-44b3-9788-f35d01a246a2-delete_snapshot'" released by "delete_snapshot" :: held 2.520s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:51.550511 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Snapshots deleted, issuing volume delete {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/manager.py:983}} Jun 18 22:17:51.550511 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:51.645773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:17:51.650217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Volume volume-a004fc56-bdef-4ab3-a24a-7efa09d68825 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:17:51.662892 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] deleting rbd volume volume-a004fc56-bdef-4ab3-a24a-7efa09d68825 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:17:52.075519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Created reservations ['dc1dca10-1ba8-4ad2-938b-7829cd575530', '68bac534-998f-47ca-8fcb-f4dee052a88f', 'ffe136f4-47fa-4972-95f4-dcacd024f0a5', 'dd4ae13d-1225-4690-9ef5-7b25259873f2'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:17:52.208366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:52.298691 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:52.393513 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:17:52.398056 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Deleted volume successfully. Jun 18 22:17:52.418273 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-92faa0d6-2229-4c21-bd4e-77cdf689bee2 tempest-VolumesDeleteCascade-1381908502 None] Lock "b'cinder-a004fc56-bdef-4ab3-a24a-7efa09d68825-delete_volume'" released by "delete_volume" :: held 4.963s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:17:56.636444 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:17:56.658131 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Flow 'volume_create_manager' (75d7bc7a-2165-4117-b297-f477b0f9d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:56.673995 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b5818f-4cc8-4c21-8331-3ae4388bc76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.692742 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b5818f-4cc8-4c21-8331-3ae4388bc76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1808437976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eac6f740-55e8-4b16-865f-3e3be7a1893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fef3f3fb34ea2b3606b8b019b40ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:17:57Z,use_quota=True,user_id='7b1e07ea16ab4ee18386f84b02a7d934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.698368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaeebc0-0c2c-47b5-b250-470fbb9c1398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.703715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaeebc0-0c2c-47b5-b250-470fbb9c1398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.710273 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a435ef-a316-42b2-bd75-ec35ed60219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.714650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a435ef-a316-42b2-bd75-ec35ed60219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac6f740-55e8-4b16-865f-3e3be7a1893f', 'volume_name': 'volume-eac6f740-55e8-4b16-865f-3e3be7a1893f', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.720853 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d6f58-0fef-4c55-a3c5-686cd714a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.731936 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d6f58-0fef-4c55-a3c5-686cd714a8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.736490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e0e25d-26c5-48c8-8027-3b0497f79b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.738507 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Volume eac6f740-55e8-4b16-865f-3e3be7a1893f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac6f740-55e8-4b16-865f-3e3be7a1893f', 'volume_size': 1} Jun 18 22:17:56.739114 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] creating volume 'volume-eac6f740-55e8-4b16-865f-3e3be7a1893f' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:17:56.740139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:56.828155 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:17:56.828864 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:17:56.836441 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e0e25d-26c5-48c8-8027-3b0497f79b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac6f740-55e8-4b16-865f-3e3be7a1893f', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.842025 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df55e942-82eb-424b-bdcc-667ea3d7e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:17:56.858302 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Volume volume-eac6f740-55e8-4b16-865f-3e3be7a1893f (eac6f740-55e8-4b16-865f-3e3be7a1893f): created successfully Jun 18 22:17:56.863756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df55e942-82eb-424b-bdcc-667ea3d7e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:17:56.875658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Flow 'volume_create_manager' (75d7bc7a-2165-4117-b297-f477b0f9d17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:17:56.886909 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-d9c9eb19-e268-4819-baa4-4e9327f6e0f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Created volume successfully. Jun 18 22:17:57.900242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-911b2fe8-21b6-4699-b23c-20be3e6c9b8d tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:17:59.211007 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-911b2fe8-21b6-4699-b23c-20be3e6c9b8d tempest-VolumesSnapshotListTestJSON-5374126 None] Create snapshot completed successfully Jun 18 22:18:00.318254 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3ea889ad-ed4b-4bbb-a340-2c5678c3c3f1 tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:01.323063 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3ea889ad-ed4b-4bbb-a340-2c5678c3c3f1 tempest-VolumesSnapshotListTestJSON-5374126 None] Create snapshot completed successfully Jun 18 22:18:02.736637 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-06b51626-3f84-4a6b-be4c-dea6a600b169 tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:03.419279 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-06b51626-3f84-4a6b-be4c-dea6a600b169 tempest-VolumesSnapshotListTestJSON-5374126 None] Create snapshot completed successfully Jun 18 22:18:05.243040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b55254ef-5550-4f44-b4b9-f89d5131ca91 tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-e3521434-cec5-481c-b3fb-e51ed31b5cad-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:18:05.252574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b55254ef-5550-4f44-b4b9-f89d5131ca91 tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:06.562292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-b55254ef-5550-4f44-b4b9-f89d5131ca91 tempest-VolumesSnapshotListTestJSON-5374126 None] Created reservations ['e8515691-4259-497f-9a64-58957a793dba', '728d1bd4-cd27-4603-94ca-572806570666', '5473c68e-26a1-4c99-a287-062490b2324e', 'c3f03d3c-0db8-49c9-ad55-87f1ceac6ad6'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:18:06.695327 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b55254ef-5550-4f44-b4b9-f89d5131ca91 tempest-VolumesSnapshotListTestJSON-5374126 None] Delete snapshot completed successfully. Jun 18 22:18:06.701902 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b55254ef-5550-4f44-b4b9-f89d5131ca91 tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-e3521434-cec5-481c-b3fb-e51ed31b5cad-delete_snapshot'" released by "delete_snapshot" :: held 1.459s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:18:07.605056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-38de7b92-05c9-41d7-a808-a254fcb130fc tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-98854326-f7b6-4f3f-a73c-f48891944aeb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:18:07.612069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-38de7b92-05c9-41d7-a808-a254fcb130fc tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:08.617065 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:08.635130 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-38de7b92-05c9-41d7-a808-a254fcb130fc tempest-VolumesSnapshotListTestJSON-5374126 None] Created reservations ['ed2c04d1-fb12-4b7a-9964-a99839bc77e3', '03392c63-d112-429e-942e-8e0ceafc5304', '54c377b9-fbff-4d39-828a-286aa0d23593', '1048559e-3f29-4143-85f1-30516ea31399'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:18:08.751316 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-38de7b92-05c9-41d7-a808-a254fcb130fc tempest-VolumesSnapshotListTestJSON-5374126 None] Delete snapshot completed successfully. Jun 18 22:18:08.760637 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-38de7b92-05c9-41d7-a808-a254fcb130fc tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-98854326-f7b6-4f3f-a73c-f48891944aeb-delete_snapshot'" released by "delete_snapshot" :: held 1.155s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:18:09.864489 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-16ba1a8c-5443-476d-aa6a-199d203c8d7c tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-8feab664-2607-4397-999f-961e9f410a2b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:18:09.867362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-16ba1a8c-5443-476d-aa6a-199d203c8d7c tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:10.591095 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=10,cinder:SELECT=46,cinder:UPDATE=39,cinder:DELETE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:10.730959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-16ba1a8c-5443-476d-aa6a-199d203c8d7c tempest-VolumesSnapshotListTestJSON-5374126 None] Created reservations ['98ed4646-2ee8-4fdd-b701-784fc70a1c69', 'b49a5bf2-1ab1-4ef3-b950-460818a394d7', 'd0a9f964-0ce1-43bb-bfc4-727ce3eb141c', '933b3f11-459a-4724-8ed2-278ff94746c3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:18:10.822285 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-16ba1a8c-5443-476d-aa6a-199d203c8d7c tempest-VolumesSnapshotListTestJSON-5374126 None] Delete snapshot completed successfully. Jun 18 22:18:10.827512 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-16ba1a8c-5443-476d-aa6a-199d203c8d7c tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-8feab664-2607-4397-999f-961e9f410a2b-delete_snapshot'" released by "delete_snapshot" :: held 0.963s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:18:11.387578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-eac6f740-55e8-4b16-865f-3e3be7a1893f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:18:11.512359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:11.617786 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:18:11.618622 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Volume volume-eac6f740-55e8-4b16-865f-3e3be7a1893f is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:18:11.633402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] deleting rbd volume volume-eac6f740-55e8-4b16-865f-3e3be7a1893f {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:18:12.093155 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Created reservations ['44759dee-69b4-4bd5-8f0b-1b4fa9d9f850', 'd7875586-7447-4019-bd4b-82c415ee160d', '66c14678-97f0-4197-8476-22105d13ed80', '61d9d545-d2c0-4c0d-b1ae-b00faae87bf8'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:18:12.203478 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:12.276132 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:12.373400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:18:12.384386 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Deleted volume successfully. Jun 18 22:18:12.418614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-eee2f467-ce2d-4624-bfe8-d45524de53db tempest-VolumesSnapshotListTestJSON-5374126 None] Lock "b'cinder-eac6f740-55e8-4b16-865f-3e3be7a1893f-delete_volume'" released by "delete_volume" :: held 1.031s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:18:29.431109 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=23,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:39.426416 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=29,cinder:UPDATE=18,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:47.271859 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:18:47.272680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:47.335595 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:18:47.415548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:18:59.433382 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:16.116058 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:16.162378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:19:16.233547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (7dd4d06a-64c7-4604-851a-43164f266909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:19:16.259475 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8620bf01-3576-4ba7-bb3a-6b7052fdad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.292679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8620bf01-3576-4ba7-bb3a-6b7052fdad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1665218764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=333dce02-30ca-476d-b896-3fb4871db3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7126d757bd748f291963f779f8eaad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:19:16Z,use_quota=True,user_id='7a41eb42094f418685b83cc0a57852d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.298106 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a68c92-9d8d-4dbc-9db6-918e82d968b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.303043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a68c92-9d8d-4dbc-9db6-918e82d968b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.308198 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6f79bc-16f4-4617-b637-4fe81a83b064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.312289 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6f79bc-16f4-4617-b637-4fe81a83b064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333dce02-30ca-476d-b896-3fb4871db3f1', 'volume_name': 'volume-333dce02-30ca-476d-b896-3fb4871db3f1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.330764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37dcb34-1269-4e73-bab7-80ea8deeb49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.355105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37dcb34-1269-4e73-bab7-80ea8deeb49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.362741 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930bb853-36f1-4158-9cc0-c7a398beab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.363872 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Volume 333dce02-30ca-476d-b896-3fb4871db3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333dce02-30ca-476d-b896-3fb4871db3f1', 'volume_size': 1} Jun 18 22:19:16.364269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] creating volume 'volume-333dce02-30ca-476d-b896-3fb4871db3f1' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:19:16.365069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:19:16.532753 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:19:16.533498 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:19:16.542095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930bb853-36f1-4158-9cc0-c7a398beab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333dce02-30ca-476d-b896-3fb4871db3f1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.557507 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb196a3-c53f-4a1d-99ab-3efff7d86f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:16.573317 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-333dce02-30ca-476d-b896-3fb4871db3f1 (333dce02-30ca-476d-b896-3fb4871db3f1): created successfully Jun 18 22:19:16.584900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb196a3-c53f-4a1d-99ab-3efff7d86f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:16.602474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (7dd4d06a-64c7-4604-851a-43164f266909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:19:16.634042 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-40210b10-884a-4b77-8c42-d09db89f3c93 tempest-AttachVolumeNegativeTest-1910758346 None] Created volume successfully. Jun 18 22:19:18.083365 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-334c6854-48f1-43f5-9808-fdc971debc32 req-012eb618-4163-43fc-a5cc-2cdceeac97d1 tempest-AttachVolumeNegativeTest-1910758346 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:19:19.539951 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-334c6854-48f1-43f5-9808-fdc971debc32 req-012eb618-4163-43fc-a5cc-2cdceeac97d1 tempest-AttachVolumeNegativeTest-1910758346 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.456s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:19:19.541402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-334c6854-48f1-43f5-9808-fdc971debc32 req-012eb618-4163-43fc-a5cc-2cdceeac97d1 tempest-AttachVolumeNegativeTest-1910758346 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-333dce02-30ca-476d-b896-3fb4871db3f1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '333dce02-30ca-476d-b896-3fb4871db3f1', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:19:19.592098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-334c6854-48f1-43f5-9808-fdc971debc32 req-012eb618-4163-43fc-a5cc-2cdceeac97d1 tempest-AttachVolumeNegativeTest-1910758346 None] Connection info returned from driver {'name': 'volumes/volume-333dce02-30ca-476d-b896-3fb4871db3f1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '333dce02-30ca-476d-b896-3fb4871db3f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '96c36804-167f-41a3-a906-14b55632da80'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:19:19.710497 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-334c6854-48f1-43f5-9808-fdc971debc32 req-012eb618-4163-43fc-a5cc-2cdceeac97d1 tempest-AttachVolumeNegativeTest-1910758346 None] attachment_update completed successfully. Jun 18 22:19:29.708615 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:39.432866 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:47.271155 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:19:47.272078 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:19:47.318422 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:19:47.361166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:19:55.978474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:19:56.023657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Flow 'volume_create_manager' (631b1d23-a17f-44d1-aef2-fe6ffd886364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:19:56.044622 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879fa881-7448-4369-a9d7-70c1f2d842a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.069785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879fa881-7448-4369-a9d7-70c1f2d842a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1383312900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ad3ba56-1c0d-49cd-9990-41fcf14a30b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c1a383333e4e30ace00bcdba714600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:19:56Z,use_quota=True,user_id='8d81ad22e9434bff9b01fb434231428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.075553 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f0472-74f3-4d49-b6d7-b425601655e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.092038 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f0472-74f3-4d49-b6d7-b425601655e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.114821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c7194-719d-485d-b955-42e139337794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.119029 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c7194-719d-485d-b955-42e139337794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'volume_name': 'volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.133528 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d484a8-8d22-43bf-8ff3-a14a809b4783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.137835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d484a8-8d22-43bf-8ff3-a14a809b4783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.150464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731e839e-a755-4cd6-a896-7281b82d5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.151569 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume 0ad3ba56-1c0d-49cd-9990-41fcf14a30b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'volume_size': 1} Jun 18 22:19:56.151964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] creating volume 'volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:19:56.166109 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:19:56.273369 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:19:56.274168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:19:56.279433 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731e839e-a755-4cd6-a896-7281b82d5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.288030 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f63399-6b68-497b-b62f-b6464e994c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:19:56.301687 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3 (0ad3ba56-1c0d-49cd-9990-41fcf14a30b3): created successfully Jun 18 22:19:56.311842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f63399-6b68-497b-b62f-b6464e994c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:19:56.325232 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Flow 'volume_create_manager' (631b1d23-a17f-44d1-aef2-fe6ffd886364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:19:56.350749 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-109128bc-ccab-4fb7-8d6e-e6fdf3f157a9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Created volume successfully. Jun 18 22:20:09.434604 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:19.434036 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:37.790347 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-9a427e9f-75f3-48f4-b34b-4e184970cd21 req-b44ccc9b-eecb-4aa4-ab6b-6130981f344b tempest-AttachVolumeNegativeTest-1910758346 None] Terminate volume connection completed successfully. Jun 18 22:20:37.792282 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-9a427e9f-75f3-48f4-b34b-4e184970cd21 req-b44ccc9b-eecb-4aa4-ab6b-6130981f344b tempest-AttachVolumeNegativeTest-1910758346 None] Deleting attachment 96c36804-167f-41a3-a906-14b55632da80. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:20:43.702750 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:43.747197 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-57504285-b83a-4637-89d8-5796fd6df463 req-0acde302-e409-468b-ad7f-527aacc3bba9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:20:44.777789 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-57504285-b83a-4637-89d8-5796fd6df463 req-0acde302-e409-468b-ad7f-527aacc3bba9 tempest-AttachVolumeShelveTestJSON-1650157146 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.030s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:20:44.779870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-57504285-b83a-4637-89d8-5796fd6df463 req-0acde302-e409-468b-ad7f-527aacc3bba9 tempest-AttachVolumeShelveTestJSON-1650157146 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:20:44.838410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-57504285-b83a-4637-89d8-5796fd6df463 req-0acde302-e409-468b-ad7f-527aacc3bba9 tempest-AttachVolumeShelveTestJSON-1650157146 None] Connection info returned from driver {'name': 'volumes/volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0ad3ba56-1c0d-49cd-9990-41fcf14a30b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '82fbf604-3698-49ad-ae4b-36e9e7a77b5d'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:20:44.950111 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-57504285-b83a-4637-89d8-5796fd6df463 req-0acde302-e409-468b-ad7f-527aacc3bba9 tempest-AttachVolumeShelveTestJSON-1650157146 None] attachment_update completed successfully. Jun 18 22:20:47.276631 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:20:47.278449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:20:47.372330 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:20:47.456657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:20:54.954853 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:59.443891 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:01.939081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:21:01.972090 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Flow 'volume_create_manager' (bd14c735-e5a8-4400-883e-6c7957c97d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:01.981690 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05a441f-7332-47ec-8b0d-fdb3c270623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.063733 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05a441f-7332-47ec-8b0d-fdb3c270623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-907351783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d98f64f-6de5-4ca6-9da0-237fd3ad8387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c346c784cb4027a7c412b200d749ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:21:02Z,use_quota=True,user_id='7780fd767b13484cb1a536802ad3c168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.073399 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8378ef-1e33-4342-88ab-b88bb6824cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.079348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8378ef-1e33-4342-88ab-b88bb6824cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.086087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74970a3e-0c35-4cfb-a624-9a292b935d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.091193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74970a3e-0c35-4cfb-a624-9a292b935d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d98f64f-6de5-4ca6-9da0-237fd3ad8387', 'volume_name': 'volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.098329 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba6d7aa-8822-4a22-bee1-68ecf6c1792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.106111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba6d7aa-8822-4a22-bee1-68ecf6c1792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.111108 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df4bb9e-3501-4391-93bb-249c75b16b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.112512 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387', 'volume_size': 1} Jun 18 22:21:02.112922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] creating volume 'volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:21:02.113904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:02.208823 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:21:02.209241 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:21:02.212927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df4bb9e-3501-4391-93bb-249c75b16b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.217742 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8bea1a-f99d-42cc-9f34-459bd9115bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:02.228226 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Volume volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387 (8d98f64f-6de5-4ca6-9da0-237fd3ad8387): created successfully Jun 18 22:21:02.233140 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8bea1a-f99d-42cc-9f34-459bd9115bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:02.239526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Flow 'volume_create_manager' (bd14c735-e5a8-4400-883e-6c7957c97d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:02.249045 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b2d67e7f-16cc-4911-a739-3544cb72f212 req-9e80bef9-6658-44aa-b16f-a1bd8666574c tempest-VolumesSnapshotsTestJSON-377884937 None] Created volume successfully. Jun 18 22:21:05.184101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-28622f41-1a95-4918-895c-1e74c5161c52 req-6919b663-a041-4f41-b9bf-b58b292c6687 tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:05.556418 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-28622f41-1a95-4918-895c-1e74c5161c52 req-6919b663-a041-4f41-b9bf-b58b292c6687 tempest-VolumesSnapshotsTestJSON-377884937 None] Create snapshot completed successfully Jun 18 22:21:07.222137 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-73e1b745-8b95-4397-846f-fecd43aadf7f req-9f43846c-1dec-4c05-a63a-bad1ab6cba80 tempest-VolumesSnapshotsTestJSON-377884937 None] Lock "b'cinder-5aace7c3-f463-49ca-b8ff-1687f8875569-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:21:07.227797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-73e1b745-8b95-4397-846f-fecd43aadf7f req-9f43846c-1dec-4c05-a63a-bad1ab6cba80 tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:07.630330 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-73e1b745-8b95-4397-846f-fecd43aadf7f req-9f43846c-1dec-4c05-a63a-bad1ab6cba80 tempest-VolumesSnapshotsTestJSON-377884937 None] Created reservations ['c20739c4-10bc-4af3-b442-53ac5f55b1e0', '7a39b1f9-e90a-4d81-bd35-05c51bfc6b8e', '6b060992-9bcb-429b-8c6f-563d0eba4b1a', '70f1f675-e03e-4602-99fe-d55e9e931c58'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:21:07.700357 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-73e1b745-8b95-4397-846f-fecd43aadf7f req-9f43846c-1dec-4c05-a63a-bad1ab6cba80 tempest-VolumesSnapshotsTestJSON-377884937 None] Delete snapshot completed successfully. Jun 18 22:21:07.711144 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-73e1b745-8b95-4397-846f-fecd43aadf7f req-9f43846c-1dec-4c05-a63a-bad1ab6cba80 tempest-VolumesSnapshotsTestJSON-377884937 None] Lock "b'cinder-5aace7c3-f463-49ca-b8ff-1687f8875569-delete_snapshot'" released by "delete_snapshot" :: held 0.489s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:21:09.826056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Lock "b'cinder-8d98f64f-6de5-4ca6-9da0-237fd3ad8387-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:21:09.884476 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:10.011137 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:21:10.014542 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Volume volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:21:10.028651 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] deleting rbd volume volume-8d98f64f-6de5-4ca6-9da0-237fd3ad8387 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:21:10.400175 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Created reservations ['964fa37f-5cc5-465c-b26b-e5433fd6b696', '06ed19a9-9cc4-4c23-82f0-1f32c94a0b2c', '8e9c7886-111c-43b3-91f6-118b598d2567', 'd19a237b-4658-4232-8f8f-699b916e7b2b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:21:10.461098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:10.501564 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:10.557894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:21:10.563511 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Deleted volume successfully. Jun 18 22:21:10.581443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-7927c4f0-6860-4371-8c76-965dd76c7e0e req-c72f0e3a-22c7-46b8-b418-cb92b00a3ada tempest-VolumesSnapshotsTestJSON-377884937 None] Lock "b'cinder-8d98f64f-6de5-4ca6-9da0-237fd3ad8387-delete_volume'" released by "delete_volume" :: held 0.755s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:21:13.577626 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:21:13.596832 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (240cf9b5-b8c4-4a78-a78a-1cf5e4e054f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:13.603106 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe79323b-83a7-4f07-9502-52f4e8e5dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.620734 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe79323b-83a7-4f07-9502-52f4e8e5dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-432705915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=75820544-c433-4f43-a9ca-ce14d20468bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa35dcd0dba49e6a30001bc4133388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:21:14Z,use_quota=True,user_id='23d4d72745e84806b66c80e9609374f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.626030 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be21f11-375c-4c8b-a9f3-d91216304f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.630042 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be21f11-375c-4c8b-a9f3-d91216304f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.634947 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab4da2-b5dc-4549-afdd-7abcaf3ccafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.638918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfab4da2-b5dc-4549-afdd-7abcaf3ccafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75820544-c433-4f43-a9ca-ce14d20468bc', 'volume_name': 'volume-75820544-c433-4f43-a9ca-ce14d20468bc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.643678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4bacb6-520d-4a48-9a73-f716899f1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.647484 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4bacb6-520d-4a48-9a73-f716899f1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.652020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342595d9-d518-44c4-a89c-1aed0a574bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.653058 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Volume 75820544-c433-4f43-a9ca-ce14d20468bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75820544-c433-4f43-a9ca-ce14d20468bc', 'volume_size': 1} Jun 18 22:21:13.653501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] creating volume 'volume-75820544-c433-4f43-a9ca-ce14d20468bc' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:21:13.654430 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:13.709336 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:21:13.709863 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:21:13.713526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342595d9-d518-44c4-a89c-1aed0a574bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75820544-c433-4f43-a9ca-ce14d20468bc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.718787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0debf14-9908-4db5-8993-854dbcda88df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:13.729177 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Volume volume-75820544-c433-4f43-a9ca-ce14d20468bc (75820544-c433-4f43-a9ca-ce14d20468bc): created successfully Jun 18 22:21:13.732656 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0debf14-9908-4db5-8993-854dbcda88df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:13.737945 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (240cf9b5-b8c4-4a78-a78a-1cf5e4e054f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:13.747536 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-95c5294a-510a-4d1f-b8f3-e5c00f639734 tempest-VolumesTestJSON-1272162193 None] Created volume successfully. Jun 18 22:21:15.013729 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:21:15.036703 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (9ee89565-d839-434d-a768-697ee20f57b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:15.043194 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c44726-55d0-48a9-8704-80d95cc81db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.061951 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c44726-55d0-48a9-8704-80d95cc81db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1786581490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=504cf1d0-bff8-4f44-b1a3-43b28acf5c5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa35dcd0dba49e6a30001bc4133388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:21:15Z,use_quota=True,user_id='23d4d72745e84806b66c80e9609374f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.069612 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c0204-bc5b-4b5c-adb7-7872cf5423d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.088652 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c0204-bc5b-4b5c-adb7-7872cf5423d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.090345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5653a8-a3ff-4299-a048-4dd604a6bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.094513 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5653a8-a3ff-4299-a048-4dd604a6bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504cf1d0-bff8-4f44-b1a3-43b28acf5c5f', 'volume_name': 'volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.099674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cacd28-c9a4-40b0-a015-1366c7a2374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.103589 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cacd28-c9a4-40b0-a015-1366c7a2374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.107936 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6db0ed-bdbc-4b47-aa41-8227175fe40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.109024 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Volume 504cf1d0-bff8-4f44-b1a3-43b28acf5c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f', 'volume_size': 1} Jun 18 22:21:15.109504 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] creating volume 'volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:21:15.110150 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:15.198756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:21:15.199302 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:21:15.205008 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6db0ed-bdbc-4b47-aa41-8227175fe40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.210884 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d49510-dbc2-4594-8bd0-96532b0de911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:15.222427 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Volume volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f (504cf1d0-bff8-4f44-b1a3-43b28acf5c5f): created successfully Jun 18 22:21:15.226393 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d49510-dbc2-4594-8bd0-96532b0de911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:15.232568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (9ee89565-d839-434d-a768-697ee20f57b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:15.243277 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9a250ac0-c623-4a85-bb01-15df15099622 tempest-VolumesTestJSON-1272162193 None] Created volume successfully. Jun 18 22:21:16.557927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:21:16.579219 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (79fa8354-c256-45c8-be9b-57d533c95138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:16.585749 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad912304-c60b-4531-be43-40d5c55519a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.602061 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad912304-c60b-4531-be43-40d5c55519a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608608783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=661a0d7d-b4a9-4432-af16-c25e983dbedc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa35dcd0dba49e6a30001bc4133388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:21:17Z,use_quota=True,user_id='23d4d72745e84806b66c80e9609374f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.607686 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d26f5b-3ef2-454f-b0f1-d4209cd5f80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.611738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d26f5b-3ef2-454f-b0f1-d4209cd5f80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.616801 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bf7130-797d-4ff9-992c-8600c337182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.620808 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bf7130-797d-4ff9-992c-8600c337182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661a0d7d-b4a9-4432-af16-c25e983dbedc', 'volume_name': 'volume-661a0d7d-b4a9-4432-af16-c25e983dbedc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.625601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e04c767-0300-4e54-a533-4bcee6a72a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.629411 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e04c767-0300-4e54-a533-4bcee6a72a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.634231 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61fc396-c8d9-4590-a60f-bdafb0de700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.635313 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Volume 661a0d7d-b4a9-4432-af16-c25e983dbedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661a0d7d-b4a9-4432-af16-c25e983dbedc', 'volume_size': 1} Jun 18 22:21:16.635857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] creating volume 'volume-661a0d7d-b4a9-4432-af16-c25e983dbedc' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:21:16.636671 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:16.708973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:21:16.709563 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:21:16.715457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61fc396-c8d9-4590-a60f-bdafb0de700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661a0d7d-b4a9-4432-af16-c25e983dbedc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.720090 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4629752-7d16-4d50-9182-5cc52789d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:21:16.731286 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Volume volume-661a0d7d-b4a9-4432-af16-c25e983dbedc (661a0d7d-b4a9-4432-af16-c25e983dbedc): created successfully Jun 18 22:21:16.736484 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4629752-7d16-4d50-9182-5cc52789d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:21:16.744614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Flow 'volume_create_manager' (79fa8354-c256-45c8-be9b-57d533c95138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:21:16.754208 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e3d3ac21-98c7-43d2-b18c-81fadb58e0da tempest-VolumesTestJSON-1272162193 None] Created volume successfully. Jun 18 22:21:19.096938 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-661a0d7d-b4a9-4432-af16-c25e983dbedc-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:21:19.139570 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:19.181904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:21:19.183973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Volume volume-661a0d7d-b4a9-4432-af16-c25e983dbedc is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:21:19.189242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] deleting rbd volume volume-661a0d7d-b4a9-4432-af16-c25e983dbedc {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:21:19.427169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Created reservations ['82d1b5b0-2c27-431e-8c6a-cf78c79a19e7', '2a127a5d-eedd-422a-ac0f-11cc57c337ad', '78f433fb-fdcb-4d65-a9ac-43da52fd1dd6', '713a6028-ff54-4b32-aa1e-7b5cdf68a9ae'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:21:19.521256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:19.597389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:19.663809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:21:19.675150 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Deleted volume successfully. Jun 18 22:21:19.702448 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a7b6b87-2ed3-4a22-a261-ec1a864b8bba tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-661a0d7d-b4a9-4432-af16-c25e983dbedc-delete_volume'" released by "delete_volume" :: held 0.606s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:21:20.249083 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:21:20.252886 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:20.278589 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:20.305156 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:20.376593 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:21:20.377218 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Volume volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:21:20.383946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] deleting rbd volume volume-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:21:20.581166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Created reservations ['58465e1c-0424-4b62-b5e9-a3cde052c12e', '2d8d9301-35dc-4ea9-9d51-6d3c5230973a', '8e05dad6-bf92-4edb-8a93-ff918ab2e5a7', '83394a6b-1bf5-404a-9732-595aa2e12c5d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:21:20.629556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:20.654072 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:20.693702 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:21:20.698218 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Deleted volume successfully. Jun 18 22:21:20.712320 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-28742446-7d45-413e-b461-acd10aad0c39 tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-504cf1d0-bff8-4f44-b1a3-43b28acf5c5f-delete_volume'" released by "delete_volume" :: held 0.463s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:21:21.404224 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-75820544-c433-4f43-a9ca-ce14d20468bc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:21:21.460894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:21.533416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:21:21.534011 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Volume volume-75820544-c433-4f43-a9ca-ce14d20468bc is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:21:21.539821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] deleting rbd volume volume-75820544-c433-4f43-a9ca-ce14d20468bc {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:21:21.820664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Created reservations ['c12b3cf2-a6a3-432d-b97b-722753bc7c01', '18c91e64-53e4-4d5a-9807-3949adeda241', '92e1dc4b-de0e-48c3-9937-6c694ae1f058', 'a8cc3f1c-f919-47f8-aa8a-a44073906ed6'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:21:21.891859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:21.971766 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:22.007233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:21:22.012763 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Deleted volume successfully. Jun 18 22:21:22.026975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e292bde6-ce8e-49f4-a3ed-0214367195f1 tempest-VolumesTestJSON-1272162193 None] Lock "b'cinder-75820544-c433-4f43-a9ca-ce14d20468bc-delete_volume'" released by "delete_volume" :: held 0.623s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:21:32.018252 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:47.276521 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:21:47.277402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:47.361392 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:21:47.426413 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:21:49.449811 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=18 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:49.803624 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-c6470126-e8ad-4709-8406-227619bc94f8 req-c8e45198-ba01-4109-8438-4d62052e4fdd tempest-AttachVolumeShelveTestJSON-1650157146 None] Terminate volume connection completed successfully. Jun 18 22:21:49.804170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-c6470126-e8ad-4709-8406-227619bc94f8 req-c8e45198-ba01-4109-8438-4d62052e4fdd tempest-AttachVolumeShelveTestJSON-1650157146 None] Deleting attachment 82fbf604-3698-49ad-ae4b-36e9e7a77b5d. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:22:09.439397 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:29.447588 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:40.897448 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:22:40.963437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (3a0aae80-ecf5-4725-bfba-b3be5edd13af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:22:40.983555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552b8c8-c3e9-4145-addb-4bea80e14243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.013537 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:41.030321 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552b8c8-c3e9-4145-addb-4bea80e14243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-908764352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=794f4393-bb2e-4407-bcd1-975dd142d8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7126d757bd748f291963f779f8eaad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:22:41Z,use_quota=True,user_id='7a41eb42094f418685b83cc0a57852d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.043313 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1425b9d-96d1-4776-b6ab-340ee1a87cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.048762 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1425b9d-96d1-4776-b6ab-340ee1a87cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.054316 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b38bb06-c5c2-4bc2-81f7-3f8be09cabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.059720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b38bb06-c5c2-4bc2-81f7-3f8be09cabbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794f4393-bb2e-4407-bcd1-975dd142d8d4', 'volume_name': 'volume-794f4393-bb2e-4407-bcd1-975dd142d8d4', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.066526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a94fd1d-1836-4f20-a3dc-c91ae2ef0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.073263 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a94fd1d-1836-4f20-a3dc-c91ae2ef0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.080445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecedf3e6-e217-4e4f-b4bc-cdb1dc7a8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.081937 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Volume 794f4393-bb2e-4407-bcd1-975dd142d8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794f4393-bb2e-4407-bcd1-975dd142d8d4', 'volume_size': 1} Jun 18 22:22:41.082536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] creating volume 'volume-794f4393-bb2e-4407-bcd1-975dd142d8d4' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:22:41.084528 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:22:41.184187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:22:41.185134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:22:41.189742 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecedf3e6-e217-4e4f-b4bc-cdb1dc7a8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794f4393-bb2e-4407-bcd1-975dd142d8d4', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.198522 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f279ca-e4c7-40cb-9246-a320e81d75c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:41.221473 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-794f4393-bb2e-4407-bcd1-975dd142d8d4 (794f4393-bb2e-4407-bcd1-975dd142d8d4): created successfully Jun 18 22:22:41.225756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f279ca-e4c7-40cb-9246-a320e81d75c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:41.234839 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (3a0aae80-ecf5-4725-bfba-b3be5edd13af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:22:41.256726 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-255ae07d-f3b1-4010-8059-d00bce30fd5a tempest-AttachVolumeNegativeTest-1910758346 None] Created volume successfully. Jun 18 22:22:43.205511 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-2635b4f1-2510-4009-a4ba-a03f9e16989c req-6d9acff9-e134-4c55-aa78-f81554909edf tempest-AttachVolumeNegativeTest-1910758346 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:22:44.978303 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-2635b4f1-2510-4009-a4ba-a03f9e16989c req-6d9acff9-e134-4c55-aa78-f81554909edf tempest-AttachVolumeNegativeTest-1910758346 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.772s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:22:44.979345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-2635b4f1-2510-4009-a4ba-a03f9e16989c req-6d9acff9-e134-4c55-aa78-f81554909edf tempest-AttachVolumeNegativeTest-1910758346 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-794f4393-bb2e-4407-bcd1-975dd142d8d4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '794f4393-bb2e-4407-bcd1-975dd142d8d4', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:22:45.049177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-2635b4f1-2510-4009-a4ba-a03f9e16989c req-6d9acff9-e134-4c55-aa78-f81554909edf tempest-AttachVolumeNegativeTest-1910758346 None] Connection info returned from driver {'name': 'volumes/volume-794f4393-bb2e-4407-bcd1-975dd142d8d4', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '794f4393-bb2e-4407-bcd1-975dd142d8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d420b44-c7ea-47b9-b266-58b44577597f'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:22:45.195365 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-2635b4f1-2510-4009-a4ba-a03f9e16989c req-6d9acff9-e134-4c55-aa78-f81554909edf tempest-AttachVolumeNegativeTest-1910758346 None] attachment_update completed successfully. Jun 18 22:22:47.277240 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:22:47.278335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:22:47.324609 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:22:47.382519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:22:48.949278 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 req-b1298f01-9d6a-494d-b8a6-19e27959fb38 tempest-AttachVolumeNegativeTest-1910758346 None] Terminate volume connection completed successfully. Jun 18 22:22:48.949914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 req-b1298f01-9d6a-494d-b8a6-19e27959fb38 tempest-AttachVolumeNegativeTest-1910758346 None] Deleting attachment 0d420b44-c7ea-47b9-b266-58b44577597f. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:22:58.278569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:22:58.316143 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Flow 'volume_create_manager' (33abdc90-ce4b-40df-bfb5-2d73d5411a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:22:58.326096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26037437-6d99-406a-85f7-9b0bede10a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.380264 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26037437-6d99-406a-85f7-9b0bede10a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1678363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bee43207-ade8-469e-aade-dadb074272c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c1a383333e4e30ace00bcdba714600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:22:58Z,use_quota=True,user_id='8d81ad22e9434bff9b01fb434231428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.395415 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ca9b0f-3755-4f1a-bcaf-e74754d7db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.412424 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ca9b0f-3755-4f1a-bcaf-e74754d7db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.434587 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57513f0-1549-4300-9b9a-173c83b67ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.444356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57513f0-1549-4300-9b9a-173c83b67ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee43207-ade8-469e-aade-dadb074272c3', 'volume_name': 'volume-bee43207-ade8-469e-aade-dadb074272c3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.449740 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195fc68f-ad89-471f-b047-4ab881d43a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.471514 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195fc68f-ad89-471f-b047-4ab881d43a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.506593 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5b4bad-6001-4451-88db-d864d05e3234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.507746 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume bee43207-ade8-469e-aade-dadb074272c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee43207-ade8-469e-aade-dadb074272c3', 'volume_size': 1} Jun 18 22:22:58.508135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] creating volume 'volume-bee43207-ade8-469e-aade-dadb074272c3' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:22:58.508794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:22:58.668347 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:22:58.668894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:22:58.680322 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5b4bad-6001-4451-88db-d864d05e3234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee43207-ade8-469e-aade-dadb074272c3', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.689953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2327900-a433-44c0-ab8c-3a768b4b75df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:22:58.715191 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume volume-bee43207-ade8-469e-aade-dadb074272c3 (bee43207-ade8-469e-aade-dadb074272c3): created successfully Jun 18 22:22:58.719656 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2327900-a433-44c0-ab8c-3a768b4b75df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:22:58.727824 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Flow 'volume_create_manager' (33abdc90-ce4b-40df-bfb5-2d73d5411a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:22:58.747906 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-72f50a58-dd98-4fd6-a0f0-c4fcc798beb6 tempest-AttachVolumeShelveTestJSON-1650157146 None] Created volume successfully. Jun 18 22:23:09.451365 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=22,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:09.453413 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:29.453301 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:39.462495 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:39.619386 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:23:39.714747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Flow 'volume_create_manager' (ebba2e9b-34c5-4f75-bde9-79f9a40d9868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:23:39.736022 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59a7c57-0c1e-4a5b-9858-e2a53208da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:39.775288 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59a7c57-0c1e-4a5b-9858-e2a53208da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1464449244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=27016f92-5a7a-435f-923e-b6679459fa15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88cba0e44af4875b05d6c3546cf0543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:23:40Z,use_quota=True,user_id='719d3fb4f7f44c239e03b5f7076edcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:39.791606 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2992645a-53d7-4716-918c-c034a9534522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:39.796426 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2992645a-53d7-4716-918c-c034a9534522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:39.803558 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550255df-956a-4c06-a570-2190014fcac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:39.808534 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550255df-956a-4c06-a570-2190014fcac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27016f92-5a7a-435f-923e-b6679459fa15', 'volume_name': 'volume-27016f92-5a7a-435f-923e-b6679459fa15', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:39.816287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8920ef-c798-4029-8050-b0a10d7fe30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:39.823479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8920ef-c798-4029-8050-b0a10d7fe30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:39.830217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67b1e6f-0be5-4f8f-986c-4d6d2574ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:39.831997 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Volume 27016f92-5a7a-435f-923e-b6679459fa15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27016f92-5a7a-435f-923e-b6679459fa15', 'volume_size': 1} Jun 18 22:23:39.832842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] creating volume 'volume-27016f92-5a7a-435f-923e-b6679459fa15' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:23:39.834107 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:23:40.003388 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:23:40.003809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:23:40.007738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67b1e6f-0be5-4f8f-986c-4d6d2574ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27016f92-5a7a-435f-923e-b6679459fa15', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:40.035486 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f684ae-9ec9-4c00-b023-058f1d54e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:40.045365 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Volume volume-27016f92-5a7a-435f-923e-b6679459fa15 (27016f92-5a7a-435f-923e-b6679459fa15): created successfully Jun 18 22:23:40.049825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f684ae-9ec9-4c00-b023-058f1d54e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:40.055382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Flow 'volume_create_manager' (ebba2e9b-34c5-4f75-bde9-79f9a40d9868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:23:40.099271 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-31249ec3-afa7-4afd-8fe7-6ee13fdcb521 tempest-ServersNegativeTestJSON-1979982008 None] Created volume successfully. Jun 18 22:23:43.844179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:23:43.919312 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Flow 'volume_create_manager' (56e18444-a087-4cfa-9b1d-b2f81251f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:23:43.943699 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812da72-e41d-4bdd-a330-1ab125506281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:43.997942 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812da72-e41d-4bdd-a330-1ab125506281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1929590520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8208790e-5d5d-46a9-8759-bba8289fd0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88cba0e44af4875b05d6c3546cf0543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:23:44Z,use_quota=True,user_id='719d3fb4f7f44c239e03b5f7076edcc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.018352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27082f9-1875-40ee-b1ad-99dea4e4a09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:44.051185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27082f9-1875-40ee-b1ad-99dea4e4a09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.070390 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dacaf99-6592-463f-8c0a-76d9c7b7ccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:44.082187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dacaf99-6592-463f-8c0a-76d9c7b7ccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8208790e-5d5d-46a9-8759-bba8289fd0dc', 'volume_name': 'volume-8208790e-5d5d-46a9-8759-bba8289fd0dc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.091067 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a9384c-eff2-4f25-8898-1a657e61d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:44.095277 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a9384c-eff2-4f25-8898-1a657e61d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.111187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a55c8d-5412-4121-a958-9071bd927046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:44.112358 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Volume 8208790e-5d5d-46a9-8759-bba8289fd0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8208790e-5d5d-46a9-8759-bba8289fd0dc', 'volume_size': 1} Jun 18 22:23:44.116141 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] creating volume 'volume-8208790e-5d5d-46a9-8759-bba8289fd0dc' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:23:44.117118 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:23:44.231310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-32e59e05-ce6b-483c-825a-9e31207df66e req-91545d6d-6de1-46b0-ab92-f0f74fb1eb3f tempest-AttachVolumeShelveTestJSON-1650157146 None] No connector for attachment 45b1c664-e926-410c-acd2-121303327545; skipping storage backend terminate_connection call. {{(pid=123873) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4913}} Jun 18 22:23:44.232214 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-32e59e05-ce6b-483c-825a-9e31207df66e req-91545d6d-6de1-46b0-ab92-f0f74fb1eb3f tempest-AttachVolumeShelveTestJSON-1650157146 None] Deleting attachment 45b1c664-e926-410c-acd2-121303327545. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:23:44.260142 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:23:44.260810 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:23:44.265550 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a55c8d-5412-4121-a958-9071bd927046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8208790e-5d5d-46a9-8759-bba8289fd0dc', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.274412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f97a59d-a394-4d00-ad58-c26fa0d3f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:23:44.291901 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Volume volume-8208790e-5d5d-46a9-8759-bba8289fd0dc (8208790e-5d5d-46a9-8759-bba8289fd0dc): created successfully Jun 18 22:23:44.297385 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f97a59d-a394-4d00-ad58-c26fa0d3f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:23:44.307122 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Flow 'volume_create_manager' (56e18444-a087-4cfa-9b1d-b2f81251f222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:23:44.330291 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-2c8b8f21-4c83-4469-b843-941fb8c76c08 tempest-ServersNegativeTestJSON-1979982008 None] Created volume successfully. Jun 18 22:23:47.277546 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:23:47.278353 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:23:47.337313 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:23:47.433521 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:23:59.459111 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:01.309179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:24:01.375415 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Flow 'volume_create_manager' (55ed6b9a-5f3a-477f-b6d3-0913ef2b1239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:01.404335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befb4334-9835-4bf3-adb3-da71f5a2551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:01.457320 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befb4334-9835-4bf3-adb3-da71f5a2551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-936133076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8dabb3c4-c9ba-4817-af56-8a86d1572234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106e2aa0adfd40da9a2d689f3b4653db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:24:01Z,use_quota=True,user_id='01ecbaf0e5004723bd6a96296ea135d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:01.467380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75beef2-7254-4f88-b9af-9be3cffb22c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:01.482677 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75beef2-7254-4f88-b9af-9be3cffb22c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:01.488169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c15a8e-2f95-4330-9452-f11abccf12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:01.629409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c15a8e-2f95-4330-9452-f11abccf12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8dabb3c4-c9ba-4817-af56-8a86d1572234', 'volume_name': 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:01.635719 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd59466a-3fd2-408f-8ce1-27e1402be5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:01.649431 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd59466a-3fd2-408f-8ce1-27e1402be5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:01.664234 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569f40e9-253b-46ca-9bde-868883e9ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:01.683735 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Volume 8dabb3c4-c9ba-4817-af56-8a86d1572234: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:24:01.687724 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Cloning 8dabb3c4-c9ba-4817-af56-8a86d1572234 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:24:01.704562 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:24:01.726599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 24, 1, 714486)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:24:01.727443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:24:01.728068 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:24:01.732700 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:24:01.733860 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:24:01.742872 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 24, 1, 739210)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:24:01.743656 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:24:01.744255 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:24:01.785425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:01.925141 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] creating snapshot='volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:24:02.932780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.clone_snap' to 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:24:03.107657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:24:03.112039 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:24:03.112948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:24:03.167686 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:24:03.168738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Marking volume 8dabb3c4-c9ba-4817-af56-8a86d1572234 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:24:03.189721 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 8dabb3c4-c9ba-4817-af56-8a86d1572234. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:24:03.190556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Creating volume glance metadata for volume 8dabb3c4-c9ba-4817-af56-8a86d1572234 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:24:03.290710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569f40e9-253b-46ca-9bde-868883e9ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:03.310113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dc05cc-984c-491d-8b55-bdc02593cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:03.339259 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Volume volume-8dabb3c4-c9ba-4817-af56-8a86d1572234 (8dabb3c4-c9ba-4817-af56-8a86d1572234): created successfully Jun 18 22:24:03.342844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dc05cc-984c-491d-8b55-bdc02593cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:03.348598 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Flow 'volume_create_manager' (55ed6b9a-5f3a-477f-b6d3-0913ef2b1239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:03.367700 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0c84b60e-03d5-4216-8995-b9ef09353db9 tempest-TestVolumeBackupRestore-341744755 None] Created volume successfully. Jun 18 22:24:05.619691 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:24:04Z,data_timestamp=2022-06-18T22:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a3698ae7-44c1-4a7d-b2c7-d321fb04718a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='106e2aa0adfd40da9a2d689f3b4653db',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='01ecbaf0e5004723bd6a96296ea135d8',volume_id=8dabb3c4-c9ba-4817-af56-8a86d1572234) Jun 18 22:24:05.637621 ncdv-master-1 cinder-volume[123873]: INFO cinder.rpc [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jun 18 22:24:05.658998 ncdv-master-1 cinder-volume[123873]: INFO cinder.rpc [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Jun 18 22:24:05.659843 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] continue_backup in rpcapi backup_id a3698ae7-44c1-4a7d-b2c7-d321fb04718a {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:24:06.075713 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:24:06.099959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (28fe4d35-6370-4b82-a7a9-4ee208cba206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:06.110016 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978e3dec-0e51-446a-bc38-cae34adef104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.143455 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978e3dec-0e51-446a-bc38-cae34adef104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455209664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=660b098a-68b1-4990-bb0e-9b88a87c9d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7126d757bd748f291963f779f8eaad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:24:06Z,use_quota=True,user_id='7a41eb42094f418685b83cc0a57852d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.151287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a0c3b1-8d0a-4c46-9de7-71749c11eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.156609 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a0c3b1-8d0a-4c46-9de7-71749c11eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.166477 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ac0235-8171-48df-87eb-1c1a90928963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.173874 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ac0235-8171-48df-87eb-1c1a90928963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660b098a-68b1-4990-bb0e-9b88a87c9d60', 'volume_name': 'volume-660b098a-68b1-4990-bb0e-9b88a87c9d60', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.179556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fd7312-8f44-4a5a-8290-43dc5b4852fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.186958 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fd7312-8f44-4a5a-8290-43dc5b4852fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.195456 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb51a2c-7a1b-45f8-ae11-414f8e10114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.196844 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Volume 660b098a-68b1-4990-bb0e-9b88a87c9d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660b098a-68b1-4990-bb0e-9b88a87c9d60', 'volume_size': 1} Jun 18 22:24:06.197433 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] creating volume 'volume-660b098a-68b1-4990-bb0e-9b88a87c9d60' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:24:06.198968 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:06.339138 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:24:06.339806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:24:06.352342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb51a2c-7a1b-45f8-ae11-414f8e10114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660b098a-68b1-4990-bb0e-9b88a87c9d60', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.360536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf99b1ce-cd48-4a5e-9c7f-5de2ba36b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:06.380098 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-660b098a-68b1-4990-bb0e-9b88a87c9d60 (660b098a-68b1-4990-bb0e-9b88a87c9d60): created successfully Jun 18 22:24:06.386807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf99b1ce-cd48-4a5e-9c7f-5de2ba36b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:06.408642 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Flow 'volume_create_manager' (28fe4d35-6370-4b82-a7a9-4ee208cba206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:06.424592 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b102ac51-63b2-456d-b8b6-ef226791681a tempest-AttachVolumeNegativeTest-1910758346 None] Created volume successfully. Jun 18 22:24:08.132957 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-88a923fe-ace0-4dde-a411-ab329334f2b8 req-3196a2b9-74d3-4b8b-aba2-69248a3b51d0 tempest-AttachVolumeNegativeTest-1910758346 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:24:09.601451 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-88a923fe-ace0-4dde-a411-ab329334f2b8 req-3196a2b9-74d3-4b8b-aba2-69248a3b51d0 tempest-AttachVolumeNegativeTest-1910758346 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.468s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:24:09.603079 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-88a923fe-ace0-4dde-a411-ab329334f2b8 req-3196a2b9-74d3-4b8b-aba2-69248a3b51d0 tempest-AttachVolumeNegativeTest-1910758346 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-660b098a-68b1-4990-bb0e-9b88a87c9d60', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '660b098a-68b1-4990-bb0e-9b88a87c9d60', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:24:09.606362 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=42,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:09.640930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-88a923fe-ace0-4dde-a411-ab329334f2b8 req-3196a2b9-74d3-4b8b-aba2-69248a3b51d0 tempest-AttachVolumeNegativeTest-1910758346 None] Connection info returned from driver {'name': 'volumes/volume-660b098a-68b1-4990-bb0e-9b88a87c9d60', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '660b098a-68b1-4990-bb0e-9b88a87c9d60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7bcde78-9095-49cc-85d9-a0f522ea6b40'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:24:09.756680 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-88a923fe-ace0-4dde-a411-ab329334f2b8 req-3196a2b9-74d3-4b8b-aba2-69248a3b51d0 tempest-AttachVolumeNegativeTest-1910758346 None] attachment_update completed successfully. Jun 18 22:24:12.992896 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-8d96bded-ee47-4368-b42c-beb230c21437 req-9883c6b8-41d3-4903-8a48-45990ec47964 tempest-AttachVolumeNegativeTest-1910758346 None] Terminate volume connection completed successfully. Jun 18 22:24:12.993577 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-8d96bded-ee47-4368-b42c-beb230c21437 req-9883c6b8-41d3-4903-8a48-45990ec47964 tempest-AttachVolumeNegativeTest-1910758346 None] Deleting attachment a7bcde78-9095-49cc-85d9-a0f522ea6b40. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:24:14.883378 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:24:15.855498 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.972s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:24:15.856526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8dabb3c4-c9ba-4817-af56-8a86d1572234', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '8dabb3c4-c9ba-4817-af56-8a86d1572234', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:24:15.890263 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Initialize volume connection completed successfully. Jun 18 22:24:24.559588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-660b098a-68b1-4990-bb0e-9b88a87c9d60-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:24:24.664265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:25.028149 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:24:25.028645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-660b098a-68b1-4990-bb0e-9b88a87c9d60 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:24:25.352977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] deleting rbd volume volume-660b098a-68b1-4990-bb0e-9b88a87c9d60 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:24:27.182200 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Created reservations ['a5d8eea1-5a18-4919-bdf4-1b91973036d4', '9f8e6589-d491-46bd-a7c0-c933c3144168', '34bce772-90f5-4908-bfef-131af20775c9', '3c8152e0-26b3-45cb-8500-4d673452399c'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:24:27.322351 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:27.411833 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:27.524355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:24:27.561519 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Deleted volume successfully. Jun 18 22:24:27.604818 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ad48b24a-330a-4ffd-a5cf-284e203e478f tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-660b098a-68b1-4990-bb0e-9b88a87c9d60-delete_volume'" released by "delete_volume" :: held 3.045s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:24:28.626680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-794f4393-bb2e-4407-bcd1-975dd142d8d4-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:24:28.732274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:28.808239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:24:28.808662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-794f4393-bb2e-4407-bcd1-975dd142d8d4 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:24:28.815564 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] deleting rbd volume volume-794f4393-bb2e-4407-bcd1-975dd142d8d4 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:24:28.825454 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Terminate volume connection completed successfully. Jun 18 22:24:28.866700 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fdd0bf00-0c80-46cd-944c-5744cf7d21c3 tempest-TestVolumeBackupRestore-341744755 None] Remove volume export completed successfully. Jun 18 22:24:29.212793 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=66,cinder:INSERT=12,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:29.244019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Created reservations ['abba876f-6351-46a8-b579-aa1ec02bc761', '11d3cfe3-c3ef-465b-a524-6028c50f06ac', '1cabe791-d8b6-43d4-bd2c-42f3dbdb7653', 'd0929b9d-44d5-489c-b438-b9dccf7bc98e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:24:29.306646 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:29.401382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:29.465105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:24:29.475593 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Deleted volume successfully. Jun 18 22:24:29.502101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a82dd53-fbbb-447b-91e0-538a4273513f tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-794f4393-bb2e-4407-bcd1-975dd142d8d4-delete_volume'" released by "delete_volume" :: held 0.878s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:24:29.954721 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:24:29.991907 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Flow 'volume_create_manager' (052956fd-1f63-4cbd-9663-85c318cdc785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:29.998648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5db6955-c987-4141-ba8e-52a4c2cee2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.018051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5db6955-c987-4141-ba8e-52a4c2cee2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:24:30Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a3698ae7-44c1-4a7d-b2c7-d321fb04718a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03029fa6-9d19-40c2-951e-e96cf9fbc135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106e2aa0adfd40da9a2d689f3b4653db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:24:30Z,use_quota=True,user_id='01ecbaf0e5004723bd6a96296ea135d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.023863 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47625f0-f904-4dd0-b29e-3a80428850a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.034237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47625f0-f904-4dd0-b29e-3a80428850a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.050999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b8ea3-ed25-450f-8e24-6ef75a30ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.055080 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b8ea3-ed25-450f-8e24-6ef75a30ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'volume_name': 'volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.075693 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e966f4b-eaa6-46d5-8eba-b710f150d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.079659 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e966f4b-eaa6-46d5-8eba-b710f150d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.094027 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3bf3de-cba7-45be-8f0e-2dbbd390f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.095189 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Volume 03029fa6-9d19-40c2-951e-e96cf9fbc135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'volume_size': 1} Jun 18 22:24:30.095601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] creating volume 'volume-03029fa6-9d19-40c2-951e-e96cf9fbc135' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:24:30.097499 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:30.157784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-333dce02-30ca-476d-b896-3fb4871db3f1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:24:30.224582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:30.299736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:24:30.300414 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Volume volume-333dce02-30ca-476d-b896-3fb4871db3f1 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:24:30.313124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] deleting rbd volume volume-333dce02-30ca-476d-b896-3fb4871db3f1 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:24:30.321304 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:24:30.321990 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:24:30.325930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3bf3de-cba7-45be-8f0e-2dbbd390f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.335095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9c2b26-830d-4440-9883-ebf25185b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:24:30.363790 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Volume volume-03029fa6-9d19-40c2-951e-e96cf9fbc135 (03029fa6-9d19-40c2-951e-e96cf9fbc135): created successfully Jun 18 22:24:30.373965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9c2b26-830d-4440-9883-ebf25185b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:24:30.385474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Flow 'volume_create_manager' (052956fd-1f63-4cbd-9663-85c318cdc785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:24:30.405932 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Created volume successfully. Jun 18 22:24:30.800988 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Created reservations ['941cbe58-925f-4f11-8a74-1803faee8e4c', '59ecf77f-7272-4090-82b8-7b68ea98bf11', '9994256b-99bf-419e-a07e-78f9a0a1b1a6', '6c44cc58-79a3-4cb2-82ef-5d61a6dc9b7a'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:24:30.919734 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:31.003465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:31.050544 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:24:31.055368 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Deleted volume successfully. Jun 18 22:24:31.076416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e98eb028-379d-45c9-b5c9-6d4b57340a50 tempest-AttachVolumeNegativeTest-1910758346 None] Lock "b'cinder-333dce02-30ca-476d-b896-3fb4871db3f1-delete_volume'" released by "delete_volume" :: held 0.919s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:24:31.253911 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:24:32.563148 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.308s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:24:32.563964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:24:32.593582 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Initialize volume connection completed successfully. Jun 18 22:24:40.621153 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Terminate volume connection completed successfully. Jun 18 22:24:40.648341 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:40.650902 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-94d93596-d7fd-42bc-9754-370529b0eae3 tempest-TestVolumeBackupRestore-341744755 None] Remove volume export completed successfully. Jun 18 22:24:47.283158 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:24:47.285226 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:47.360300 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:24:47.433502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:24:49.214187 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 req-26eabd37-62cb-44ca-8635-7964bcbf3109 tempest-TestVolumeBackupRestore-341744755 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:24:50.448854 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 req-26eabd37-62cb-44ca-8635-7964bcbf3109 tempest-TestVolumeBackupRestore-341744755 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.233s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:24:50.449692 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 req-26eabd37-62cb-44ca-8635-7964bcbf3109 tempest-TestVolumeBackupRestore-341744755 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:24:50.477510 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 req-26eabd37-62cb-44ca-8635-7964bcbf3109 tempest-TestVolumeBackupRestore-341744755 None] Connection info returned from driver {'name': 'volumes/volume-03029fa6-9d19-40c2-951e-e96cf9fbc135', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03029fa6-9d19-40c2-951e-e96cf9fbc135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a5d08fd9-ea11-47cc-a36c-307bce5f1534'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:24:50.623175 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 req-26eabd37-62cb-44ca-8635-7964bcbf3109 tempest-TestVolumeBackupRestore-341744755 None] attachment_update completed successfully. Jun 18 22:24:59.473481 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=21,cinder:SELECT=43,cinder:DELETE=2,cinder:INSERT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:07.187050 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c586ea66-2f34-4b59-812a-93d8b40fbf3f tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-1655982456: creating Jun 18 22:25:07.233386 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c586ea66-2f34-4b59-812a-93d8b40fbf3f tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-1655982456: created successfully Jun 18 22:25:07.258309 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c586ea66-2f34-4b59-812a-93d8b40fbf3f tempest-GroupSnapshotsTest-1782290924 None] Create group completed successfully. Jun 18 22:25:09.214580 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:25:09.259003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (565d948b-59fe-4564-81a8-c6f321c5be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:09.268604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe382f8-43be-42ba-951c-078d02ef300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.293138 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe382f8-43be-42ba-951c-078d02ef300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-873607073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=481f0954-3f82-443f-9d94-ff161d9d7268,host='ncdv-master-1@ceph#ceph',id=f5157745-09b6-40e6-9ff2-618be8adf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c433048c745a08058f28b2f24d6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:25:09Z,use_quota=True,user_id='4fa263df7091456e87794b49f49bc965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbd1be7a-fa7b-4817-80de-a7cbfff6f735),volume_type_id=dbd1be7a-fa7b-4817-80de-a7cbfff6f735)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.315476 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb9041-8c1c-43a1-b525-7877663d68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.327623 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb9041-8c1c-43a1-b525-7877663d68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.341306 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0577c6f-af21-44d7-baaa-df667d029016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.345962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0577c6f-af21-44d7-baaa-df667d029016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5157745-09b6-40e6-9ff2-618be8adf545', 'volume_name': 'volume-f5157745-09b6-40e6-9ff2-618be8adf545', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.363648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0cee3a-436a-46d9-8090-2393aca28973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.375103 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0cee3a-436a-46d9-8090-2393aca28973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.396288 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4da36bf-44e4-419d-b057-2f5f939d628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.399467 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Volume f5157745-09b6-40e6-9ff2-618be8adf545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5157745-09b6-40e6-9ff2-618be8adf545', 'volume_size': 1} Jun 18 22:25:09.402578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] creating volume 'volume-f5157745-09b6-40e6-9ff2-618be8adf545' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:25:09.404800 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:09.596272 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:25:09.596888 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:25:09.601445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4da36bf-44e4-419d-b057-2f5f939d628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5157745-09b6-40e6-9ff2-618be8adf545', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.610240 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d67b248-f68e-4378-93d9-bc2007ac3e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:09.659984 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-f5157745-09b6-40e6-9ff2-618be8adf545 (f5157745-09b6-40e6-9ff2-618be8adf545): created successfully Jun 18 22:25:09.665350 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d67b248-f68e-4378-93d9-bc2007ac3e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:09.682458 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (565d948b-59fe-4564-81a8-c6f321c5be33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:09.707122 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e07d9226-9dd9-4f74-87d1-bba7c46422a6 tempest-GroupSnapshotsTest-1782290924 None] Created volume successfully. Jun 18 22:25:10.926808 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e4d33799-fa5f-4990-b3d0-e243dd7b78a6 tempest-GroupSnapshotsTest-1782290924 None] GroupSnapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: creating. Jun 18 22:25:11.003433 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:11.075402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e4d33799-fa5f-4990-b3d0-e243dd7b78a6 tempest-GroupSnapshotsTest-1782290924 None] Group snapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: creating. {{(pid=123873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 18 22:25:11.148334 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e4d33799-fa5f-4990-b3d0-e243dd7b78a6 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:11.862322 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e4d33799-fa5f-4990-b3d0-e243dd7b78a6 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: created successfully Jun 18 22:25:13.494705 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] cloning volumes/volume-f5157745-09b6-40e6-9ff2-618be8adf545@snapshot-51fcbd5c-e85b-47c3-8b7e-6699251cb311 to volume-b157e3ac-e346-4d3a-8456-1129238a762a {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:25:13.496059 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:13.592192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:13.934431 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:25:13.935134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:25:13.940034 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:14.020082 ncdv-master-1 cinder-volume[123873]: WARNING cinder.volume.drivers.rbd [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Jun 18 22:25:14.151211 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6d71308b-4f73-47d6-8e32-49c1727920ac tempest-GroupSnapshotsTest-1782290924 None] Create group from source-snapshot-7dfab0d9-76a4-42d1-a4b4-18416381898d completed successfully. Jun 18 22:25:15.847488 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:16.009896 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:16.030464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] deleting rbd volume volume-b157e3ac-e346-4d3a-8456-1129238a762a {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:16.831157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['f72cf87a-9284-4baa-ab0d-7cdf49e06a21'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:16.870627 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1237911304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1237911304, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:16.874539 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1237911304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1237911304, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:16.905049 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['0eab3ba7-9448-4d55-8cbe-a2b52d5cd2b6', '0ddde82b-fd3b-48c0-a77e-4a73032aad25', '7270c079-a7f4-4e12-a5b2-0177cbf6cb0c', '878e9acc-fd48-4ca8-8c8d-c0858fdff92a'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:17.084976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:17.188950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:17.280378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:17.285101 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4de6eec2-3526-4ab7-9c93-e967de8f161b tempest-GroupSnapshotsTest-1782290924 None] Delete group completed successfully. Jun 18 22:25:18.288734 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: deleting Jun 18 22:25:18.383295 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: deleting {{(pid=123873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 18 22:25:18.467726 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:19.820164 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1237911304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1237911304, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:19.869451 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['ea01055d-2cb0-4347-bc8d-bdcda6d483c0', 'd85f418a-b6ea-4e3e-9e0c-20047988989c', 'ae141d96-0809-438d-a75b-2fd022d79fe1', '1bfd3027-b630-4412-b89c-6b3b432946ad'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:19.970680 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a3c9d4f0-f21d-41be-b01f-06d580514112 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 7dfab0d9-76a4-42d1-a4b4-18416381898d: deleted successfully Jun 18 22:25:21.459130 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:21.553158 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:21.553865 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Volume volume-f5157745-09b6-40e6-9ff2-618be8adf545 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:21.569844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] deleting rbd volume volume-f5157745-09b6-40e6-9ff2-618be8adf545 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:22.157245 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['be0efc74-d699-46bd-9251-cb51c27b291e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:22.174343 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=69,cinder:UPDATE=24,cinder:INSERT=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:22.177612 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=75,cinder:UPDATE=22,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:22.233073 ncdv-master-1 cinder-volume[123873]: WARNING cinder.db.sqlalchemy.api [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1237911304'] Jun 18 22:25:22.241708 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['0410b021-7a58-45bf-b1d3-b795f781754c', '3fb065c8-6e56-4d6d-9a41-1c2e4a073273', 'c4f564df-21e4-4d10-a641-66f9d7701a38', '83a3dd02-3115-4720-9867-ee6b6366e9c5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:22.403116 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:22.530178 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:22.632125 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:22.646110 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-32664cbc-b287-4d45-86a5-80a24d10003f tempest-GroupSnapshotsTest-1782290924 None] Delete group completed successfully. Jun 18 22:25:23.431945 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-93a56d06-e75b-43a7-9ebb-50d2b05ac462 tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-2051404746: creating Jun 18 22:25:23.521685 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-93a56d06-e75b-43a7-9ebb-50d2b05ac462 tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-2051404746: created successfully Jun 18 22:25:23.548716 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-93a56d06-e75b-43a7-9ebb-50d2b05ac462 tempest-GroupSnapshotsTest-1782290924 None] Create group completed successfully. Jun 18 22:25:25.503757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:25:25.529749 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (6efd0756-d5a0-4ecb-aa35-cfc7c11d2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:25.537463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383ed864-a08b-417e-8d7b-04686c721d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.564589 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383ed864-a08b-417e-8d7b-04686c721d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-228281783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc02ca52-69da-4199-8a4c-40490fd8c75f,host='ncdv-master-1@ceph#ceph',id=320fef0d-3aa6-4e60-b67e-3eaab34064e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c433048c745a08058f28b2f24d6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:25:25Z,use_quota=True,user_id='4fa263df7091456e87794b49f49bc965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194f915d-1f7c-4d64-adc4-0543816f6058),volume_type_id=194f915d-1f7c-4d64-adc4-0543816f6058)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.571059 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0e0e5-2bb0-4e08-932b-2aae34b32a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.575699 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e0e0e5-2bb0-4e08-932b-2aae34b32a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.581953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdad823-71dc-43b8-a7d6-51081a7ffdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.587416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdad823-71dc-43b8-a7d6-51081a7ffdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320fef0d-3aa6-4e60-b67e-3eaab34064e6', 'volume_name': 'volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.593627 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23441d18-4f9f-48ce-bb9c-3a26ffbe29ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.599292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23441d18-4f9f-48ce-bb9c-3a26ffbe29ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.605345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20b8bb-7a5d-48c6-b73b-740c36b25096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.606911 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Volume 320fef0d-3aa6-4e60-b67e-3eaab34064e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6', 'volume_size': 1} Jun 18 22:25:25.607500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] creating volume 'volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:25:25.608642 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:25.776163 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:25:25.776720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:25:25.782170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20b8bb-7a5d-48c6-b73b-740c36b25096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.787397 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b150b27-e5f0-478b-8bb3-3b1b313b8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:25.814389 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6 (320fef0d-3aa6-4e60-b67e-3eaab34064e6): created successfully Jun 18 22:25:25.819580 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b150b27-e5f0-478b-8bb3-3b1b313b8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:25.828216 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (6efd0756-d5a0-4ecb-aa35-cfc7c11d2e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:25.852921 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9284aa93-a7f0-41b2-968b-8bcc98f62c06 tempest-GroupSnapshotsTest-1782290924 None] Created volume successfully. Jun 18 22:25:27.875098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:25:27.961176 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (bb74d522-0c00-4937-a5a9-ca60c1553033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:27.987906 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcfdce5-6f0d-49cd-b054-ebc318b8d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.057470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcfdce5-6f0d-49cd-b054-ebc318b8d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1322186361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc02ca52-69da-4199-8a4c-40490fd8c75f,host='ncdv-master-1@ceph#ceph',id=945a884a-a380-43d4-b18e-7547c545c991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c433048c745a08058f28b2f24d6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:25:28Z,use_quota=True,user_id='4fa263df7091456e87794b49f49bc965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194f915d-1f7c-4d64-adc4-0543816f6058),volume_type_id=194f915d-1f7c-4d64-adc4-0543816f6058)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.088908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a387571d-5fa7-4461-ae99-f51161418ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.119798 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a387571d-5fa7-4461-ae99-f51161418ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.140039 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc2294b-964b-4d8c-a267-139ce52a9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.145997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc2294b-964b-4d8c-a267-139ce52a9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945a884a-a380-43d4-b18e-7547c545c991', 'volume_name': 'volume-945a884a-a380-43d4-b18e-7547c545c991', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.156733 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873793ab-9024-43df-aa0e-7d2718dfac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.163885 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873793ab-9024-43df-aa0e-7d2718dfac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.169806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75032293-5675-4e64-8e51-66d93af724a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.173708 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Volume 945a884a-a380-43d4-b18e-7547c545c991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945a884a-a380-43d4-b18e-7547c545c991', 'volume_size': 1} Jun 18 22:25:28.174328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] creating volume 'volume-945a884a-a380-43d4-b18e-7547c545c991' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:25:28.178086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:28.511582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:25:28.511967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:25:28.515759 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75032293-5675-4e64-8e51-66d93af724a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945a884a-a380-43d4-b18e-7547c545c991', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.520582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53b31bc-85d7-496b-bc40-d7b5eed06425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:28.589175 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-945a884a-a380-43d4-b18e-7547c545c991 (945a884a-a380-43d4-b18e-7547c545c991): created successfully Jun 18 22:25:28.592677 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53b31bc-85d7-496b-bc40-d7b5eed06425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:28.632060 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (bb74d522-0c00-4937-a5a9-ca60c1553033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:28.677928 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-526b4cfe-45ba-415f-8a7f-172c120fbf27 tempest-GroupSnapshotsTest-1782290924 None] Created volume successfully. Jun 18 22:25:29.294964 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f759da5d-f817-4a3b-a0e7-9657c9207d34 tempest-GroupSnapshotsTest-1782290924 None] Update group completed successfully. Jun 18 22:25:30.949889 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5c0ae231-0803-426d-8b18-856e848b209e tempest-GroupSnapshotsTest-1782290924 None] Update group completed successfully. Jun 18 22:25:32.115494 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f51cd099-b7c8-449f-897a-5cac1d3ec1a2 tempest-GroupSnapshotsTest-1782290924 None] Update group completed successfully. Jun 18 22:25:33.365753 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-d41df780-ac46-46e9-9a22-cfbc94e2098e tempest-GroupSnapshotsTest-1782290924 None] Update group completed successfully. Jun 18 22:25:35.205062 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7c713af3-946c-428a-a401-227c13d4d8cc tempest-GroupSnapshotsTest-1782290924 None] GroupSnapshot 406cdbd9-2513-4138-a13c-77818315f032: creating. Jun 18 22:25:35.265961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7c713af3-946c-428a-a401-227c13d4d8cc tempest-GroupSnapshotsTest-1782290924 None] Group snapshot 406cdbd9-2513-4138-a13c-77818315f032: creating. {{(pid=123873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 18 22:25:35.300072 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7c713af3-946c-428a-a401-227c13d4d8cc tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:36.372532 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7c713af3-946c-428a-a401-227c13d4d8cc tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:37.443685 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7c713af3-946c-428a-a401-227c13d4d8cc tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 406cdbd9-2513-4138-a13c-77818315f032: created successfully Jun 18 22:25:38.340008 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Lock "b'cinder-bee43207-ade8-469e-aade-dadb074272c3-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:25:38.428361 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:38.575775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:38.575775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume volume-bee43207-ade8-469e-aade-dadb074272c3 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:38.594400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] deleting rbd volume volume-bee43207-ade8-469e-aade-dadb074272c3 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:38.720074 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 406cdbd9-2513-4138-a13c-77818315f032: deleting Jun 18 22:25:38.761732 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 406cdbd9-2513-4138-a13c-77818315f032: deleting {{(pid=123873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 18 22:25:38.824063 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:39.583371 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Created reservations ['1514332e-c615-4bd2-b060-8cd508785f7d', 'bee474c1-a3e5-45d4-aaf7-1f468d52816c', 'ed475900-8433-40a6-bd9c-328c07684b95', '2b2ffa6f-c603-4656-8466-a0d142ab03d9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:39.648806 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=6,cinder:SELECT=70,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:39.705503 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=72,cinder:INSERT=2,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:39.776923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:39.849460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:39.954610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:39.967733 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Deleted volume successfully. Jun 18 22:25:39.997350 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bbc8cd78-a02f-4fda-9493-bc71f3f5e4a8 tempest-AttachVolumeShelveTestJSON-1650157146 None] Lock "b'cinder-bee43207-ade8-469e-aade-dadb074272c3-delete_volume'" released by "delete_volume" :: held 1.657s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:25:40.437925 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:41.061418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Lock "b'cinder-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3-delete_volume'" acquired by "delete_volume" :: waited 0.059s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:25:41.298932 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:41.450347 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:41.450891 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Volume volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:41.463728 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] deleting rbd volume volume-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:41.634822 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1041483192 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1041483192, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:41.635805 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1041483192 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1041483192, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:41.672159 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['5eaddae4-d2ff-44d3-a3d1-5c4034cce3c1', 'b84af885-2e00-49c6-90e5-ef73caf344b7', 'ce89c617-9b72-48c1-8193-8827623317a5', 'f12db5a3-84dd-4121-8739-38b8d9e9acd5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:41.894167 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['4a408fc0-fef1-486e-b95f-062e1c080beb', 'f6e6530e-5e67-490c-b70f-6d61b0f9b684', '59080567-7cc8-409d-bf05-d3e17d9c2195', 'ccd68347-bb63-4178-8491-1b8594fef1b2'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:42.051598 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-edb4a33d-a2c2-41fd-84e8-dd17fea76d11 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 406cdbd9-2513-4138-a13c-77818315f032: deleted successfully Jun 18 22:25:42.558710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Created reservations ['b44367fd-07a7-4e01-b42c-aa9958866a9c', 'ade92c00-7752-40c6-944c-6d43f4304e0f', 'a4667990-be90-4120-b471-cbc3dc90c6ce', '12e6132e-7b8f-4af3-a53e-0d40fc6ef78a'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:42.756900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:42.822995 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:42.892964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:42.905565 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Deleted volume successfully. Jun 18 22:25:42.932517 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cb76035a-b347-48b2-b60a-0637380fa41b tempest-AttachVolumeShelveTestJSON-1650157146 None] Lock "b'cinder-0ad3ba56-1c0d-49cd-9990-41fcf14a30b3-delete_volume'" released by "delete_volume" :: held 1.871s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:25:43.138315 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:43.246901 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:43.247335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:43.265969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] deleting rbd volume volume-320fef0d-3aa6-4e60-b67e-3eaab34064e6 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:44.071972 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:44.213797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:44.214227 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-945a884a-a380-43d4-b18e-7547c545c991 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:44.243018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] deleting rbd volume volume-945a884a-a380-43d4-b18e-7547c545c991 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:45.212466 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['8a983801-17ae-4b10-8628-9a9d4935ece9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:45.246686 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1041483192 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1041483192, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:45.274250 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['441b2855-2e07-4066-9ded-377310048861', '9028b664-15e2-4485-a288-6e4e53fb05c1', '9c09867e-2358-41e5-aa91-5c9cf9cf9f70', 'c1b69b22-0cd0-4b6e-ac69-3b277273cbd0'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:45.342365 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:DELETE=2,cinder:SELECT=56,cinder:UPDATE=32,cinder:INSERT=10 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:45.427878 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=56,cinder:UPDATE=35,cinder:INSERT=9 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:45.430707 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['55acbfc7-b52c-49cc-b80a-70c758314892', 'aa29d58c-4875-485d-b1c5-640a88685b96', '894a68c5-66a5-4b42-92f0-2b91aa7e7e3a', 'f8aa4272-c039-49e0-bdb1-d3628a3ac280'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:45.599601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:45.681353 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:45.745680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:45.751180 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e96076e1-c9c0-4c8d-b96a-2f660f0379e3 tempest-GroupSnapshotsTest-1782290924 None] Delete group completed successfully. Jun 18 22:25:47.278920 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:25:47.279526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:47.356762 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:47.444328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:47.489635 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0d754bfe-f22d-44d3-b9ca-84afbb185827 tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-366588728: creating Jun 18 22:25:47.530426 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0d754bfe-f22d-44d3-b9ca-84afbb185827 tempest-GroupSnapshotsTest-1782290924 None] Group tempest-GroupSnapshotsTest-Group-366588728: created successfully Jun 18 22:25:47.555614 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0d754bfe-f22d-44d3-b9ca-84afbb185827 tempest-GroupSnapshotsTest-1782290924 None] Create group completed successfully. Jun 18 22:25:49.670804 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:25:49.748351 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (c748be98-281f-4f97-bf25-b65b2b52d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:49.773558 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a395a2-a4d5-432e-bfde-2d540d169083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:49.813924 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a395a2-a4d5-432e-bfde-2d540d169083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-797849453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=066b7f53-df00-4cf3-beed-894d2142dfd2,host='ncdv-master-1@ceph#ceph',id=51b65872-bc7a-46b2-a217-69113054dce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c433048c745a08058f28b2f24d6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:25:50Z,use_quota=True,user_id='4fa263df7091456e87794b49f49bc965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f2a4853-7cd5-40b4-8bcb-d95f42efcefb),volume_type_id=8f2a4853-7cd5-40b4-8bcb-d95f42efcefb)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:49.834023 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58c5e6-c467-4f62-8ff5-3cd07371da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:49.843490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58c5e6-c467-4f62-8ff5-3cd07371da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:49.864764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6894dbe5-0f29-4c5c-b821-69fef4769ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:49.905121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6894dbe5-0f29-4c5c-b821-69fef4769ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b65872-bc7a-46b2-a217-69113054dce8', 'volume_name': 'volume-51b65872-bc7a-46b2-a217-69113054dce8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:49.917152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d5c6d2-785c-4e7f-be66-49bde85091a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:49.929496 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d5c6d2-785c-4e7f-be66-49bde85091a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:49.942685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc945285-745b-4e5b-bbaf-3d22e78d4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:49.947296 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Volume 51b65872-bc7a-46b2-a217-69113054dce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b65872-bc7a-46b2-a217-69113054dce8', 'volume_size': 1} Jun 18 22:25:49.947843 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] creating volume 'volume-51b65872-bc7a-46b2-a217-69113054dce8' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:25:49.952376 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:50.138052 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:25:50.138801 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:25:50.142869 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc945285-745b-4e5b-bbaf-3d22e78d4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b65872-bc7a-46b2-a217-69113054dce8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:50.155082 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f3f74d-34fd-4c30-9be4-7455d9e3c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:25:50.186653 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Volume volume-51b65872-bc7a-46b2-a217-69113054dce8 (51b65872-bc7a-46b2-a217-69113054dce8): created successfully Jun 18 22:25:50.198474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f3f74d-34fd-4c30-9be4-7455d9e3c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:25:50.224426 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Flow 'volume_create_manager' (c748be98-281f-4f97-bf25-b65b2b52d97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:25:50.241585 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5c3d6d9a-c28f-45e7-b1ca-0ed1ffc95782 tempest-GroupSnapshotsTest-1782290924 None] Created volume successfully. Jun 18 22:25:51.421223 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-38c765f5-d136-4427-9060-68111d5bd3bb tempest-GroupSnapshotsTest-1782290924 None] GroupSnapshot 726b684c-55e2-42a5-9742-aa790d894acd: creating. Jun 18 22:25:51.487335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-38c765f5-d136-4427-9060-68111d5bd3bb tempest-GroupSnapshotsTest-1782290924 None] Group snapshot 726b684c-55e2-42a5-9742-aa790d894acd: creating. {{(pid=123873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 18 22:25:51.549801 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-38c765f5-d136-4427-9060-68111d5bd3bb tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:52.810561 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-38c765f5-d136-4427-9060-68111d5bd3bb tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 726b684c-55e2-42a5-9742-aa790d894acd: created successfully Jun 18 22:25:54.114020 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 726b684c-55e2-42a5-9742-aa790d894acd: deleting Jun 18 22:25:54.196299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 726b684c-55e2-42a5-9742-aa790d894acd: deleting {{(pid=123873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 18 22:25:54.272373 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:55.795616 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1201565070 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1201565070, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:55.798934 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1201565070 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1201565070, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:55.848297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['b0654221-7bc4-499f-83a4-a9db85a6191e', '27a7670a-7063-4111-86ad-fd12f84d19a0', '71485c06-923a-4c88-9e29-16fdbed3350f', '9618f24c-505b-4ece-b693-3c0316c07cbe'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:55.935397 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bb830f91-3cf4-4c65-8951-62352aac2a70 tempest-GroupSnapshotsTest-1782290924 None] group_snapshot 726b684c-55e2-42a5-9742-aa790d894acd: deleted successfully Jun 18 22:25:57.475632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:57.638093 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:25:57.639352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Volume volume-51b65872-bc7a-46b2-a217-69113054dce8 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:25:57.654862 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] deleting rbd volume volume-51b65872-bc7a-46b2-a217-69113054dce8 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:25:58.357338 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['f722b50e-0b52-42cb-b39f-e47f080e0227'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:58.394009 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1201565070 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1201565070, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:25:58.435536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Created reservations ['30dd52d4-9a94-4238-a30a-ea2bbce28e00', 'be91a10f-9dc6-413e-9b57-7cf63430610e', '54c05597-b6cb-4bd3-a6ee-1c15a3a329c6', '7034cb19-1542-4fe1-ad2b-904dc264b07e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:25:58.545470 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=4,cinder:SELECT=59,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:58.617472 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:58.664991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:25:58.773371 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:25:58.788720 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7e5de92a-7a10-4459-9723-1b1c6f22b6ec tempest-GroupSnapshotsTest-1782290924 None] Delete group completed successfully. Jun 18 22:26:04.547930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:26:04.591020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Flow 'volume_create_manager' (6b4df55c-a931-497e-85fb-3422e3be8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:04.630252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc766d2-9ec3-4c61-b4b1-5c07bfc36b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:04.668101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc766d2-9ec3-4c61-b4b1-5c07bfc36b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-136809590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0afb57ac-b5fc-405a-bfc5-02ff53d84d74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c7fe1f21f51409983c5138795103066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:26:04Z,use_quota=True,user_id='f9165a71c5cf45cebce374e33f4beb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:04.694667 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b251c8f3-a852-444f-8b42-8cc7528ef61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:04.705068 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b251c8f3-a852-444f-8b42-8cc7528ef61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:04.712594 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece0c088-913c-4110-b11d-3fcdc8ade131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:04.737545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece0c088-913c-4110-b11d-3fcdc8ade131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afb57ac-b5fc-405a-bfc5-02ff53d84d74', 'volume_name': 'volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:04.788410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706c1fb2-b687-46ff-8821-fc1be685a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:04.792658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706c1fb2-b687-46ff-8821-fc1be685a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:04.814775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea63ca-9d44-4d1b-930e-de8fe5458276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:04.831092 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74', 'volume_size': 1} Jun 18 22:26:04.831798 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] creating volume 'volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:26:04.833512 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:05.093312 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:26:05.093678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:26:05.097748 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea63ca-9d44-4d1b-930e-de8fe5458276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:05.109247 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92ac2a-1ced-4dee-85d1-288040e76d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:05.134999 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Volume volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74 (0afb57ac-b5fc-405a-bfc5-02ff53d84d74): created successfully Jun 18 22:26:05.139453 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92ac2a-1ced-4dee-85d1-288040e76d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:05.150911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Flow 'volume_create_manager' (6b4df55c-a931-497e-85fb-3422e3be8f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:05.171057 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-21b68287-8351-4295-aafe-e25dac926ba9 req-a5634b9f-0b3f-405f-8d15-c4e5f4acc0ed tempest-VolumesGetTestJSON-2037134410 None] Created volume successfully. Jun 18 22:26:05.177417 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:05.910547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Lock "b'cinder-0afb57ac-b5fc-405a-bfc5-02ff53d84d74-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:06.005484 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:06.110263 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:26:06.110725 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Volume volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:06.124138 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] deleting rbd volume volume-0afb57ac-b5fc-405a-bfc5-02ff53d84d74 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:06.715797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Created reservations ['eb4fcea5-fa67-4b58-a950-5ae50ba0494f', 'c0e9361e-5cab-448f-bda8-54a000a3de29', '11169976-b220-46c8-a5ba-9985c7be763d', '5bfa32c6-a696-4481-b64f-db1ec8d86491'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:06.816821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:06.883167 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:06.943859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:06.959704 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Deleted volume successfully. Jun 18 22:26:06.999241 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 req-cfe58351-87d9-46ad-98ff-6c36e8146a4e tempest-VolumesGetTestJSON-2037134410 None] Lock "b'cinder-0afb57ac-b5fc-405a-bfc5-02ff53d84d74-delete_volume'" released by "delete_volume" :: held 1.092s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:19.514050 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:21.078437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:26:21.100868 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Flow 'volume_create_manager' (f0b71f1a-8d2c-4b55-b779-2764a93a8cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:21.109744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97cc6cc-87bf-4297-9ce5-d2b854efd6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.133832 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97cc6cc-87bf-4297-9ce5-d2b854efd6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1772043057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6fc38993-2b5b-443d-a04a-e6ec322cb1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29fe11a501a4392be8d6a602d663a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:26:21Z,use_quota=True,user_id='04a60f11de2a4456857bfd41622192fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.139186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa3d85e-a55d-47bb-bb3b-dbd22f3a8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.145726 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa3d85e-a55d-47bb-bb3b-dbd22f3a8cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.152064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967d3636-b8b9-4372-bd1e-e3a185f6d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.157007 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967d3636-b8b9-4372-bd1e-e3a185f6d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc38993-2b5b-443d-a04a-e6ec322cb1c2', 'volume_name': 'volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.163712 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa63ccfb-16d6-45c0-86c3-08f79eb65b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.167946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa63ccfb-16d6-45c0-86c3-08f79eb65b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.173438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7331ed8-b37c-4643-8160-37d8176406dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.174877 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Volume 6fc38993-2b5b-443d-a04a-e6ec322cb1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2', 'volume_size': 1} Jun 18 22:26:21.175617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] creating volume 'volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:26:21.176904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:21.299888 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:26:21.301712 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:26:21.309448 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7331ed8-b37c-4643-8160-37d8176406dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.322662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0b7379-def5-4413-9610-9a19dba8993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:21.351579 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Volume volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2 (6fc38993-2b5b-443d-a04a-e6ec322cb1c2): created successfully Jun 18 22:26:21.351579 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0b7379-def5-4413-9610-9a19dba8993c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:21.358507 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Flow 'volume_create_manager' (f0b71f1a-8d2c-4b55-b779-2764a93a8cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:21.374179 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4b00e33f-1188-437b-be3d-1f5f264c6318 tempest-VolumesServicesTestJSON-1467440126 None] Created volume successfully. Jun 18 22:26:22.524298 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Lock "b'cinder-6fc38993-2b5b-443d-a04a-e6ec322cb1c2-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:22.625186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:22.727599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:26:22.728021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Volume volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:22.747383 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] deleting rbd volume volume-6fc38993-2b5b-443d-a04a-e6ec322cb1c2 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:23.077093 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Created reservations ['a0c36ec2-0ace-4aab-a1db-3ff75006647f', '795cd051-b3cf-4ac2-8be5-6289a5672b51', 'd5f58691-3ed5-4c4e-80ea-e20976a881c5', '574c38a2-7cc5-4fef-be57-4b5ec41c54ab'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:23.162636 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:23.241393 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:23.294420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:23.299714 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Deleted volume successfully. Jun 18 22:26:23.322908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e41f2982-3f18-4a41-84cd-7fefb9cea89b tempest-VolumesServicesTestJSON-1467440126 None] Lock "b'cinder-6fc38993-2b5b-443d-a04a-e6ec322cb1c2-delete_volume'" released by "delete_volume" :: held 0.803s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:27.914667 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 req-83251573-580e-4e57-95be-4bac1fa19270 tempest-TestVolumeBackupRestore-341744755 None] Terminate volume connection completed successfully. Jun 18 22:26:27.915369 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 req-83251573-580e-4e57-95be-4bac1fa19270 tempest-TestVolumeBackupRestore-341744755 None] Deleting attachment a5d08fd9-ea11-47cc-a36c-307bce5f1534. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:26:29.772330 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-03029fa6-9d19-40c2-951e-e96cf9fbc135-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:29.842813 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:30.389579 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Volume volume-03029fa6-9d19-40c2-951e-e96cf9fbc135 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:30.442352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] deleting rbd volume volume-03029fa6-9d19-40c2-951e-e96cf9fbc135 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:30.459117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-8dabb3c4-c9ba-4817-af56-8a86d1572234-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:30.530374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:31.495214 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] deleting rbd volume volume-8dabb3c4-c9ba-4817-af56-8a86d1572234 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:31.711261 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Created reservations ['613c4ad2-fd9a-44ce-afdb-32337c1be38e', '8988a329-78e9-411e-9c17-1d047b3e0ec5', '5242dbc5-ed3f-45bb-a08a-b5ccf8daf8ca', 'e4f21034-52a4-4fa2-bbd8-cae8fe2fc6af'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:31.832741 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:31.900948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:31.972381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:31.980347 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:26:32.067655 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] deleting parent snapshot volume-8dabb3c4-c9ba-4817-af56-8a86d1572234.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:26:32.442341 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Deleted volume successfully. Jun 18 22:26:32.478739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3da7b674-2afb-4a5c-9702-4c60f0436f2c tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-03029fa6-9d19-40c2-951e-e96cf9fbc135-delete_volume'" released by "delete_volume" :: held 2.706s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:32.492720 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:32.513428 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] Created reservations ['290e1ec1-4196-4b27-bdaf-b8713caf93ce', '418e8fc4-ea92-482d-821c-f72b6af345e1', '8b8192e9-4c6c-424b-8224-075474a8f3bb', '651de43d-89fe-45dc-a2c1-129ac94137e9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:32.586598 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:32.648661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:32.697973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:32.710821 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] Deleted volume successfully. Jun 18 22:26:32.729391 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-66a1a481-2e8c-4eac-bd3a-c1722f8c1c75 tempest-TestVolumeBackupRestore-341744755 None] Lock "b'cinder-8dabb3c4-c9ba-4817-af56-8a86d1572234-delete_volume'" released by "delete_volume" :: held 2.269s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:33.302912 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Lock "b'cinder-8208790e-5d5d-46a9-8759-bba8289fd0dc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:33.386124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:33.469911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:26:33.470358 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Volume volume-8208790e-5d5d-46a9-8759-bba8289fd0dc is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:33.477779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] deleting rbd volume volume-8208790e-5d5d-46a9-8759-bba8289fd0dc {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:33.857154 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Created reservations ['8a8bbb53-a353-4f27-a3e5-7787611cd0ef', 'a53dcfec-1a48-49af-926f-a3997c41e6a3', '188ef0b1-dbdf-4c0c-9be7-9c9603f59d6b', 'b2c2a3dd-d2b8-43fc-9189-80c2e5b608e5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:33.939997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:34.004929 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:34.100253 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:34.111412 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Deleted volume successfully. Jun 18 22:26:34.130838 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b0c0e1e4-97c0-4e46-a9fa-61b448cb56c3 tempest-ServersNegativeTestJSON-1979982008 None] Lock "b'cinder-8208790e-5d5d-46a9-8759-bba8289fd0dc-delete_volume'" released by "delete_volume" :: held 0.828s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:34.498265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Lock "b'cinder-27016f92-5a7a-435f-923e-b6679459fa15-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:34.537798 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:INSERT=10,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:34.542310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:34.619096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:26:34.619538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Volume volume-27016f92-5a7a-435f-923e-b6679459fa15 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:34.626409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] deleting rbd volume volume-27016f92-5a7a-435f-923e-b6679459fa15 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:34.907967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Created reservations ['336fdc57-08d0-4b85-9f46-c1767debd82d', '21b71ec4-4b48-4dc2-a518-258b1b7d7965', 'ae398c52-0a2b-49f9-8e4b-580b0e0d89bb', '9c5e4982-7a76-44e1-bd7d-234a186b2e79'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:35.014224 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:35.098977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:35.179517 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:35.183635 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Deleted volume successfully. Jun 18 22:26:35.203020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-de096609-a1b1-4026-9675-96908cb2f5be tempest-ServersNegativeTestJSON-1979982008 None] Lock "b'cinder-27016f92-5a7a-435f-923e-b6679459fa15-delete_volume'" released by "delete_volume" :: held 0.705s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:37.148402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:26:37.172004 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Flow 'volume_create_manager' (9998b01e-a92c-44cc-b0e2-e58959db8132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:37.180395 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81cc357-44bf-4696-af47-c88c88f9a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.221728 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81cc357-44bf-4696-af47-c88c88f9a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1371032508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=561adf69-9b09-4ce4-923b-7804ba0606ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58240accc193488fafd486b2bfc19064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:26:37Z,use_quota=True,user_id='2528ddd1080546b89e299d23701a8520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c271c474-a12c-4e14-b8f9-e1f5b362d4a4),volume_type_id=c271c474-a12c-4e14-b8f9-e1f5b362d4a4)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.233362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf0cc7-cad7-40da-997d-6a6483c972d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.237730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf0cc7-cad7-40da-997d-6a6483c972d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.243247 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cab2a55-52c6-432b-8092-8760b4ad8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.247380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cab2a55-52c6-432b-8092-8760b4ad8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561adf69-9b09-4ce4-923b-7804ba0606ce', 'volume_name': 'volume-561adf69-9b09-4ce4-923b-7804ba0606ce', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.258169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e29404-3f29-4208-a328-5626b8efd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.265791 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e29404-3f29-4208-a328-5626b8efd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.278137 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5599eb-b698-4ded-9894-890b579722cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.283726 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Volume 561adf69-9b09-4ce4-923b-7804ba0606ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561adf69-9b09-4ce4-923b-7804ba0606ce', 'volume_size': 1} Jun 18 22:26:37.284397 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] creating volume 'volume-561adf69-9b09-4ce4-923b-7804ba0606ce' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:26:37.285382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:37.413295 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:26:37.413919 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:26:37.418096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5599eb-b698-4ded-9894-890b579722cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561adf69-9b09-4ce4-923b-7804ba0606ce', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.422876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c558abe-1528-4989-bf8d-ba4a8a2e2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:37.450667 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Volume volume-561adf69-9b09-4ce4-923b-7804ba0606ce (561adf69-9b09-4ce4-923b-7804ba0606ce): created successfully Jun 18 22:26:37.454640 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c558abe-1528-4989-bf8d-ba4a8a2e2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:37.460501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Flow 'volume_create_manager' (9998b01e-a92c-44cc-b0e2-e58959db8132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:37.484281 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-86bccdcf-f2c1-443e-8488-f77f8d973bde tempest-VolumeTypesAccessTest-857319813 None] Created volume successfully. Jun 18 22:26:38.790744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Lock "b'cinder-561adf69-9b09-4ce4-923b-7804ba0606ce-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:26:38.854109 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:38.956318 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:26:38.957519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Volume volume-561adf69-9b09-4ce4-923b-7804ba0606ce is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:26:38.967352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] deleting rbd volume volume-561adf69-9b09-4ce4-923b-7804ba0606ce {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:26:39.260157 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1742478255 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1742478255, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:26:39.261746 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1742478255 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1742478255, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:26:39.295962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Created reservations ['3d51f7d9-04ca-4b7d-99e9-bf241bff2b39', '31da0a6f-a371-4983-af2f-f1a81c901219', '24915709-7fbf-4e54-bf73-891db6475131', '1abf3f6e-d5fa-438c-a6cf-805e0848d004'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:26:39.378827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:39.459571 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:39.559803 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:39.591186 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Deleted volume successfully. Jun 18 22:26:39.620269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-97d42cfa-6af7-4d53-88dc-af522e6c32d5 tempest-VolumeTypesAccessTest-857319813 None] Lock "b'cinder-561adf69-9b09-4ce4-923b-7804ba0606ce-delete_volume'" released by "delete_volume" :: held 0.830s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:26:47.275080 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:26:47.276252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:47.317618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:47.356967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:26:56.354520 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-06d4d933-380a-4ce9-844e-ddf52eb04169 tempest-GroupsTest-693445074 None] Group tempest-Group1-290681410: creating Jun 18 22:26:56.396217 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-06d4d933-380a-4ce9-844e-ddf52eb04169 tempest-GroupsTest-693445074 None] Group tempest-Group1-290681410: created successfully Jun 18 22:26:56.402590 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=36,cinder:SELECT=53,cinder:INSERT=8,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.415530 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-06d4d933-380a-4ce9-844e-ddf52eb04169 tempest-GroupsTest-693445074 None] Create group completed successfully. Jun 18 22:26:57.739347 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a0b361de-be4a-47e4-b7c4-d73ee4714b49 tempest-GroupsTest-693445074 None] Group tempest-Group2-1798203479: creating Jun 18 22:26:57.770750 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a0b361de-be4a-47e4-b7c4-d73ee4714b49 tempest-GroupsTest-693445074 None] Group tempest-Group2-1798203479: created successfully Jun 18 22:26:57.786537 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a0b361de-be4a-47e4-b7c4-d73ee4714b49 tempest-GroupsTest-693445074 None] Create group completed successfully. Jun 18 22:26:59.416984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:26:59.450303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (3a7c8cca-63dc-4e44-af40-c7ad1031c80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:59.461930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b59e60d-00ed-4fa4-8b56-22aaf90e5d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.482005 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b59e60d-00ed-4fa4-8b56-22aaf90e5d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160107334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ce510b4-47e9-4e87-9f12-68efb973f4a9,host='ncdv-master-1@ceph#ceph',id=4673024a-f38c-4f50-982c-999fe22c627c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e58c7426ac47dda531c1ee4838f3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:26:59Z,use_quota=True,user_id='070972ca7aa746e8af3aaa82579cca33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(044b566b-03fe-4fdc-be76-f8080240078f),volume_type_id=044b566b-03fe-4fdc-be76-f8080240078f)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.488061 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb549c1-386b-465d-8e9c-204d206fcb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.492650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb549c1-386b-465d-8e9c-204d206fcb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.497770 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50afd7d-a350-4c43-9c41-0aac9d5253cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.502443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50afd7d-a350-4c43-9c41-0aac9d5253cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4673024a-f38c-4f50-982c-999fe22c627c', 'volume_name': 'volume-4673024a-f38c-4f50-982c-999fe22c627c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.507444 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648c8acf-6cb1-4f2b-b3cc-7330c955e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.511575 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648c8acf-6cb1-4f2b-b3cc-7330c955e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.517383 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4775e8-f709-4a62-bffb-49b44b3d157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.518623 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Volume 4673024a-f38c-4f50-982c-999fe22c627c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4673024a-f38c-4f50-982c-999fe22c627c', 'volume_size': 1} Jun 18 22:26:59.519195 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] creating volume 'volume-4673024a-f38c-4f50-982c-999fe22c627c' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:26:59.520239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:26:59.593596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:26:59.594334 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:26:59.600921 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4775e8-f709-4a62-bffb-49b44b3d157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4673024a-f38c-4f50-982c-999fe22c627c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.605600 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fbcea8-a6de-4335-a562-f276a81ea97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:26:59.617173 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Volume volume-4673024a-f38c-4f50-982c-999fe22c627c (4673024a-f38c-4f50-982c-999fe22c627c): created successfully Jun 18 22:26:59.624020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fbcea8-a6de-4335-a562-f276a81ea97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:26:59.631561 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (3a7c8cca-63dc-4e44-af40-c7ad1031c80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:26:59.642235 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-42a41935-be95-4fab-8773-75e8c5711582 tempest-GroupsTest-693445074 None] Created volume successfully. Jun 18 22:27:01.347590 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:01.435540 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:01.436530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Volume volume-4673024a-f38c-4f50-982c-999fe22c627c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:01.452214 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] deleting rbd volume volume-4673024a-f38c-4f50-982c-999fe22c627c {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:01.824953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Created reservations ['fe0acd4e-4f49-4801-be13-1f69bc7b77d0'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:01.872014 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-764736234 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-764736234, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:01.872961 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-764736234 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-764736234, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:01.909753 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Created reservations ['6e32df4e-0296-4bfc-b393-e93ddd6b1983', '99c501bc-e773-43f3-95d5-b1daf893b4b8', 'f05c8c16-091f-46ce-a396-42f906ebf071', '4bc516e4-c7ea-41b3-8f22-5150b204cac1'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:02.068291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:02.146029 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:02.218697 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:02.223894 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-112bcb10-83a1-412c-9106-f9f661c2cef9 tempest-GroupsTest-693445074 None] Delete group completed successfully. Jun 18 22:27:02.604193 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=59,cinder:INSERT=5,cinder:UPDATE=36 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:02.693923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-87fd6695-1795-490b-90c2-7e454599c2f3 tempest-GroupsTest-693445074 None] Created reservations ['0f7ead97-e35e-434f-9725-72b4dcbb597d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:02.753760 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87fd6695-1795-490b-90c2-7e454599c2f3 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:02.810541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-87fd6695-1795-490b-90c2-7e454599c2f3 tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:02.883954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-87fd6695-1795-490b-90c2-7e454599c2f3 tempest-GroupsTest-693445074 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:02.889677 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-87fd6695-1795-490b-90c2-7e454599c2f3 tempest-GroupsTest-693445074 None] Delete group completed successfully. Jun 18 22:27:04.539317 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-42bb3063-ddb1-4708-8d2a-a0c4fdd3dbf8 tempest-GroupsTest-693445074 None] Group tempest-GroupsTest-Group-1051301178: creating Jun 18 22:27:04.562808 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-42bb3063-ddb1-4708-8d2a-a0c4fdd3dbf8 tempest-GroupsTest-693445074 None] Group tempest-GroupsTest-Group-1051301178: created successfully Jun 18 22:27:04.578142 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-42bb3063-ddb1-4708-8d2a-a0c4fdd3dbf8 tempest-GroupsTest-693445074 None] Create group completed successfully. Jun 18 22:27:06.228949 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:06.264147 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (3b480133-3cc9-4b3d-a6d2-b1021c70eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:06.271530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af69a01-9f3f-4609-8d21-06fcbdd2f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.289684 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af69a01-9f3f-4609-8d21-06fcbdd2f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-149584960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81b678ac-6f30-41f7-9481-2202a086f9d9,host='ncdv-master-1@ceph#ceph',id=da878d42-375c-4ee1-9749-bbf0cef9f000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e58c7426ac47dda531c1ee4838f3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:06Z,use_quota=True,user_id='070972ca7aa746e8af3aaa82579cca33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69d4cc8f-3321-425d-9e4a-04d39a2513cb),volume_type_id=69d4cc8f-3321-425d-9e4a-04d39a2513cb)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.295705 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61234de5-200c-4093-9f8a-781e3d24ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.300100 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61234de5-200c-4093-9f8a-781e3d24ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.305992 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d51bec7-87d9-490e-8854-9fd6d0c474c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.310409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d51bec7-87d9-490e-8854-9fd6d0c474c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da878d42-375c-4ee1-9749-bbf0cef9f000', 'volume_name': 'volume-da878d42-375c-4ee1-9749-bbf0cef9f000', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.318225 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc76eda-7fce-429f-82f2-9167570ff9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.322948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc76eda-7fce-429f-82f2-9167570ff9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.328508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e16603-9a65-4310-8e9a-50e936ee4710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.329974 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Volume da878d42-375c-4ee1-9749-bbf0cef9f000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da878d42-375c-4ee1-9749-bbf0cef9f000', 'volume_size': 1} Jun 18 22:27:06.330559 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] creating volume 'volume-da878d42-375c-4ee1-9749-bbf0cef9f000' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:06.331528 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:06.471304 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:06.471692 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:06.476352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e16603-9a65-4310-8e9a-50e936ee4710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da878d42-375c-4ee1-9749-bbf0cef9f000', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.481578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0360dd-d0ce-4d59-aa14-5c8f1ecd4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:06.494401 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Volume volume-da878d42-375c-4ee1-9749-bbf0cef9f000 (da878d42-375c-4ee1-9749-bbf0cef9f000): created successfully Jun 18 22:27:06.499279 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0360dd-d0ce-4d59-aa14-5c8f1ecd4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:06.506865 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (3b480133-3cc9-4b3d-a6d2-b1021c70eef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:06.530854 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-52734fc5-dcbc-49b6-a4b7-008a7bce8e8c tempest-GroupsTest-693445074 None] Created volume successfully. Jun 18 22:27:08.087882 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:08.117134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (968eb96c-54f5-49c1-a075-d39896070dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:08.125650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11b0d20-7c7e-4262-aac4-0ca5733a26e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.145458 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11b0d20-7c7e-4262-aac4-0ca5733a26e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1008548154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81b678ac-6f30-41f7-9481-2202a086f9d9,host='ncdv-master-1@ceph#ceph',id=40154cde-7b59-4eb5-b720-d9317e2f47fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e58c7426ac47dda531c1ee4838f3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:08Z,use_quota=True,user_id='070972ca7aa746e8af3aaa82579cca33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69d4cc8f-3321-425d-9e4a-04d39a2513cb),volume_type_id=69d4cc8f-3321-425d-9e4a-04d39a2513cb)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.152346 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3040d1b-ca03-4d5a-a960-3bbbc8471377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.158421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3040d1b-ca03-4d5a-a960-3bbbc8471377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.164964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f03a5f-5d4d-4fc7-ab76-2a3cc967da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.169933 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f03a5f-5d4d-4fc7-ab76-2a3cc967da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40154cde-7b59-4eb5-b720-d9317e2f47fa', 'volume_name': 'volume-40154cde-7b59-4eb5-b720-d9317e2f47fa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.175578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d48ca89-e13d-4f77-b5a4-e187eaa5b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.181307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d48ca89-e13d-4f77-b5a4-e187eaa5b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.186789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9c80f9-2288-4781-add9-d0870954493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.189160 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Volume 40154cde-7b59-4eb5-b720-d9317e2f47fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40154cde-7b59-4eb5-b720-d9317e2f47fa', 'volume_size': 1} Jun 18 22:27:08.189755 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] creating volume 'volume-40154cde-7b59-4eb5-b720-d9317e2f47fa' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:08.190927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:08.274984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:08.275413 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:08.281757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9c80f9-2288-4781-add9-d0870954493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40154cde-7b59-4eb5-b720-d9317e2f47fa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.291192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47738ff4-636f-445f-81d0-62fe0a930c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:08.304948 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Volume volume-40154cde-7b59-4eb5-b720-d9317e2f47fa (40154cde-7b59-4eb5-b720-d9317e2f47fa): created successfully Jun 18 22:27:08.313786 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47738ff4-636f-445f-81d0-62fe0a930c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:08.326733 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Flow 'volume_create_manager' (968eb96c-54f5-49c1-a075-d39896070dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:08.343512 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f6f947de-22e8-401e-a2ee-dc7bdaa56d4e tempest-GroupsTest-693445074 None] Created volume successfully. Jun 18 22:27:09.422794 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5f304dee-276e-446e-bc6f-e8e5907400be tempest-GroupsTest-693445074 None] Update group completed successfully. Jun 18 22:27:10.957812 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f5bcc060-4a4c-4b5f-b9bc-8c61e1fd7efb tempest-GroupsTest-693445074 None] Update group completed successfully. Jun 18 22:27:12.670982 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:12.760956 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:12.761409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Volume volume-40154cde-7b59-4eb5-b720-d9317e2f47fa is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:12.768345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] deleting rbd volume volume-40154cde-7b59-4eb5-b720-d9317e2f47fa {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:13.026774 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:13.109363 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:13.109993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Volume volume-da878d42-375c-4ee1-9749-bbf0cef9f000 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:13.128300 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] deleting rbd volume volume-da878d42-375c-4ee1-9749-bbf0cef9f000 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:13.448381 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=74,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:13.455848 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Created reservations ['dd496a8e-e5c7-4ec1-916e-75bdd42f9d1f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:13.482587 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-56706813 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-56706813, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:13.483626 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-56706813 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-56706813, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:13.509167 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Created reservations ['c97c287e-963e-45ff-9bd6-93474decdce5', '365a9f0b-f883-4039-ac7f-adcfd12922e5', '1002ec07-85ef-4762-816b-7b83cbae0c72', '7f013334-62ad-47b7-a272-9e5ed8d13431'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:13.624648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Created reservations ['ee8d576e-2a03-47f6-8089-06031cb289cf', 'dacaa408-b76f-4713-b68d-8cecfb2ab244', 'a24c42a2-3909-4e12-95a2-9570e4e92c28', '7f552607-607b-4e3f-9a64-60b95d1dafbf'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:13.759420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:13.853817 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:13.927601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:13.931769 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-eef6d569-1200-4594-ad1d-de1f4456af8b tempest-GroupsTest-693445074 None] Delete group completed successfully. Jun 18 22:27:21.066773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:21.112165 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (09434f12-8a7d-4b98-a6d6-a64966b11384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:21.115821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a895184-a248-427e-81c0-9574dad9e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.133525 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a895184-a248-427e-81c0-9574dad9e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105366962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c5faed64-47bd-4c2c-ae24-c5a82bff2970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:21Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.138910 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72a1d02-0129-49cf-8374-2f2275c4b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.143106 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72a1d02-0129-49cf-8374-2f2275c4b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.148246 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b10329-9a5f-4742-9645-9c73410ebb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.152492 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b10329-9a5f-4742-9645-9c73410ebb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5faed64-47bd-4c2c-ae24-c5a82bff2970', 'volume_name': 'volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.157668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4ef728-07fd-4ef1-a482-5e0ada3808ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.162258 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4ef728-07fd-4ef1-a482-5e0ada3808ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.174284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2078942b-9d12-44bf-973f-ee41147d8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.175564 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Volume c5faed64-47bd-4c2c-ae24-c5a82bff2970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970', 'volume_size': 1} Jun 18 22:27:21.176270 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] creating volume 'volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:21.177213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:21.301068 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:21.303045 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:21.307990 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2078942b-9d12-44bf-973f-ee41147d8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.318219 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb03652d-d88c-420a-a79d-035ae4f2919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:21.334602 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Volume volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970 (c5faed64-47bd-4c2c-ae24-c5a82bff2970): created successfully Jun 18 22:27:21.340478 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb03652d-d88c-420a-a79d-035ae4f2919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:21.347287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (09434f12-8a7d-4b98-a6d6-a64966b11384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:21.364336 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9e8520d8-4e1e-4bdf-bb18-3eef4fbdd2ce tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:22.139736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e60fd4bf-226f-4b87-9853-3d685b8dee73 tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970'" acquired by "attach_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:22.203512 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.216048 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e60fd4bf-226f-4b87-9853-3d685b8dee73 tempest-VolumesActionsTest-584218559 None] Attaching volume c5faed64-47bd-4c2c-ae24-c5a82bff2970 to instance 22b0e532-5527-4b12-99ef-a37d00064f88 at mountpoint /dev/sdb on host None. Jun 18 22:27:22.250449 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e60fd4bf-226f-4b87-9853-3d685b8dee73 tempest-VolumesActionsTest-584218559 None] Attach volume completed successfully. Jun 18 22:27:22.258569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e60fd4bf-226f-4b87-9853-3d685b8dee73 tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970'" released by "attach_volume" :: held 0.119s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:23.374778 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-34290334-de31-4b27-a5af-7f3e18a4694b tempest-VolumesActionsTest-206417076 None] Terminate volume connection completed successfully. Jun 18 22:27:23.433368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-34290334-de31-4b27-a5af-7f3e18a4694b tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:23.468557 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-34290334-de31-4b27-a5af-7f3e18a4694b tempest-VolumesActionsTest-206417076 None] Detaching volume c5faed64-47bd-4c2c-ae24-c5a82bff2970 from instance 22b0e532-5527-4b12-99ef-a37d00064f88. Jun 18 22:27:23.562746 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-34290334-de31-4b27-a5af-7f3e18a4694b tempest-VolumesActionsTest-206417076 None] Detach volume completed successfully. Jun 18 22:27:23.571745 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-34290334-de31-4b27-a5af-7f3e18a4694b tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-detach_volume'" released by "detach_volume" :: held 0.138s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:23.909502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10c47ea4-c26e-4646-8a64-3231924aef07 tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:23.910090 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-10c47ea4-c26e-4646-8a64-3231924aef07 tempest-VolumesActionsTest-584218559 None] Volume detach called, but volume not attached. Jun 18 22:27:23.925702 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10c47ea4-c26e-4646-8a64-3231924aef07 tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-detach_volume'" released by "detach_volume" :: held 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:30.903299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:30.942209 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (a1c14ef1-5856-4543-8709-aa5b746922ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:30.958373 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1001cc-80b0-4b1b-9c4f-b275f70efb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.037754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1001cc-80b0-4b1b-9c4f-b275f70efb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832968883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f60265c1-546e-4ba7-89ac-7d3da8e31bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:31Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.058017 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dc229b-747a-4865-9f39-bd41e482ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.069111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dc229b-747a-4865-9f39-bd41e482ab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.083881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905f073e-9f71-4b85-bfca-49311ae0264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.097606 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905f073e-9f71-4b85-bfca-49311ae0264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60265c1-546e-4ba7-89ac-7d3da8e31bde', 'volume_name': 'volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.112490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01e03df-a7c7-48b5-9589-11dae0c746ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.123301 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01e03df-a7c7-48b5-9589-11dae0c746ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.132751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30119708-5de0-4c42-a3c9-fc5a6e17a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.134569 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Volume f60265c1-546e-4ba7-89ac-7d3da8e31bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde', 'volume_size': 1} Jun 18 22:27:31.135177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] creating volume 'volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:31.136084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:31.260627 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:31.260999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:31.267276 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30119708-5de0-4c42-a3c9-fc5a6e17a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.284943 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d75012-f9ee-4d0e-a010-977887c61600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.310117 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Volume volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde (f60265c1-546e-4ba7-89ac-7d3da8e31bde): created successfully Jun 18 22:27:31.321495 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d75012-f9ee-4d0e-a010-977887c61600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.327900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (a1c14ef1-5856-4543-8709-aa5b746922ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:31.346966 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f594830e-064b-4f06-a3d7-61b076725bfe tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:31.457905 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:31.512624 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Flow 'volume_create_manager' (87fae5fb-5b07-4162-a91e-ae165b8ed86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:31.525614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6376f5c4-dc91-479f-8090-afd4b4010478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.558021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6376f5c4-dc91-479f-8090-afd4b4010478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1133520956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc80357d-51d3-4290-b32b-f15f342b548a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0a5e05f446472ab2f36dcb5a530771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:31Z,use_quota=True,user_id='06a69c369e4c4d0496d29997bef4254e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c745d5ed-a381-4898-9b05-31b333a48085),volume_type_id=c745d5ed-a381-4898-9b05-31b333a48085)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.564113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15da1151-f86c-4307-ae32-41c09a4cec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.568736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15da1151-f86c-4307-ae32-41c09a4cec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.574420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab13f78-6a98-4732-958d-7e083e13ce9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.579661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab13f78-6a98-4732-958d-7e083e13ce9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc80357d-51d3-4290-b32b-f15f342b548a', 'volume_name': 'volume-fc80357d-51d3-4290-b32b-f15f342b548a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.585268 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09adb831-20de-4622-92a9-7ccf96b05e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.590096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09adb831-20de-4622-92a9-7ccf96b05e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.595483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252bf928-af66-4cbb-b884-0648d0c30810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.597099 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Volume fc80357d-51d3-4290-b32b-f15f342b548a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc80357d-51d3-4290-b32b-f15f342b548a', 'volume_size': 1} Jun 18 22:27:31.597645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] creating volume 'volume-fc80357d-51d3-4290-b32b-f15f342b548a' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:31.598429 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:31.712679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:31.713698 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:31.718789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252bf928-af66-4cbb-b884-0648d0c30810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc80357d-51d3-4290-b32b-f15f342b548a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.724361 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1b59b5-6b84-453b-9a29-4f3617d86959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:31.736193 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Volume volume-fc80357d-51d3-4290-b32b-f15f342b548a (fc80357d-51d3-4290-b32b-f15f342b548a): created successfully Jun 18 22:27:31.741707 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1b59b5-6b84-453b-9a29-4f3617d86959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:31.748680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Flow 'volume_create_manager' (87fae5fb-5b07-4162-a91e-ae165b8ed86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:31.766556 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f9e45e95-24a6-4102-bdbb-0fdd082bc193 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Created volume successfully. Jun 18 22:27:32.260694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-f60265c1-546e-4ba7-89ac-7d3da8e31bde-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:32.341951 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:32.459754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:32.460383 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Volume volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:32.471402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] deleting rbd volume volume-f60265c1-546e-4ba7-89ac-7d3da8e31bde {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:32.904297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:32.955825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (d2fa8687-4b0d-4ab5-8b43-fa94bebd0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:32.970815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfe90ab-dce4-4b86-94e8-93d76195ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:32.990580 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfe90ab-dce4-4b86-94e8-93d76195ac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1933368085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aba020c7-b736-46ee-a1d6-be5789623a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76301551c4574f299511a993dc871890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:33Z,use_quota=True,user_id='3f6133e6ab7745118bc629dd126189e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:32.996324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e033ce7-9311-4125-868d-6cee55332c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:33.001737 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e033ce7-9311-4125-868d-6cee55332c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:33.006815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e9344-6cdd-4be7-8d40-9e739711cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:33.012104 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e9344-6cdd-4be7-8d40-9e739711cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba020c7-b736-46ee-a1d6-be5789623a04', 'volume_name': 'volume-aba020c7-b736-46ee-a1d6-be5789623a04', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:33.017879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f3dad0-5efc-449d-b838-1a272ead9c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:33.029084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f3dad0-5efc-449d-b838-1a272ead9c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:33.029421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d3594-2bb0-48a5-baa6-ddd3d420e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:33.030548 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Volume aba020c7-b736-46ee-a1d6-be5789623a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba020c7-b736-46ee-a1d6-be5789623a04', 'volume_size': 1} Jun 18 22:27:33.031041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] creating volume 'volume-aba020c7-b736-46ee-a1d6-be5789623a04' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:33.031999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:33.172369 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:33.172962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:33.179669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d3594-2bb0-48a5-baa6-ddd3d420e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba020c7-b736-46ee-a1d6-be5789623a04', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:33.184978 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8ecf9a-1b5f-47d2-9d33-079c8285004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:33.221533 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Volume volume-aba020c7-b736-46ee-a1d6-be5789623a04 (aba020c7-b736-46ee-a1d6-be5789623a04): created successfully Jun 18 22:27:33.227981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8ecf9a-1b5f-47d2-9d33-079c8285004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:33.234582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (d2fa8687-4b0d-4ab5-8b43-fa94bebd0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:33.255882 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=8,cinder:UPDATE=35,cinder:SELECT=57 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:33.259327 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f98a5cad-f1a0-49f2-8239-1216992abcb3 tempest-AttachVolumeTestJSON-223712319 None] Created volume successfully. Jun 18 22:27:33.268769 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Created reservations ['22abcc85-0b6a-4db3-8818-dd425befd320', '9d6cefaa-9020-4942-aa4f-b8ae462e2c7d', 'c46a206a-dc0f-4310-9f4c-b03507edc048', '1d07e19f-c86b-45f0-a511-0fd73543f4a3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:33.369168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:33.447627 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:33.510224 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:33.515470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c63167e4-22fc-4f6d-9411-dde6aa7ab481 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:33.577927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c63167e4-22fc-4f6d-9411-dde6aa7ab481 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:33.650897 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-c63167e4-22fc-4f6d-9411-dde6aa7ab481 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:33.654492 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Deleted volume successfully. Jun 18 22:27:33.688467 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c63167e4-22fc-4f6d-9411-dde6aa7ab481 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Retype volume completed successfully. Jun 18 22:27:33.691302 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0b04c0f0-b5d9-45e6-b7d1-20abacd701f9 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-f60265c1-546e-4ba7-89ac-7d3da8e31bde-delete_volume'" released by "delete_volume" :: held 1.431s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:34.305377 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:34.351438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (b93559a4-7b65-4f1b-9af6-78079ec6f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:34.358304 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb182c0-102a-4f45-8b21-49878008667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.397662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb182c0-102a-4f45-8b21-49878008667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413092990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60882689-f21d-41f0-adb7-6f1a40cc4acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:34Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.409933 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b7fffd-1591-4a4a-b097-a1b706fafe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.425920 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b7fffd-1591-4a4a-b097-a1b706fafe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.434640 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbdef8b-f989-4219-81b6-c4494529e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.448015 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbdef8b-f989-4219-81b6-c4494529e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60882689-f21d-41f0-adb7-6f1a40cc4acd', 'volume_name': 'volume-60882689-f21d-41f0-adb7-6f1a40cc4acd', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.453252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b346785b-24af-494a-8c75-ea6948e8c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.464590 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b346785b-24af-494a-8c75-ea6948e8c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.474261 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255f720c-df2c-42d4-9a09-7cb59a5c60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.476794 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Volume 60882689-f21d-41f0-adb7-6f1a40cc4acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60882689-f21d-41f0-adb7-6f1a40cc4acd', 'volume_size': 1} Jun 18 22:27:34.477235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] creating volume 'volume-60882689-f21d-41f0-adb7-6f1a40cc4acd' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:34.477996 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:34.648961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:34.649352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:34.653406 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255f720c-df2c-42d4-9a09-7cb59a5c60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60882689-f21d-41f0-adb7-6f1a40cc4acd', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.667157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba28ef16-563c-4d22-9a35-f2291dba2b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:34.698248 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Volume volume-60882689-f21d-41f0-adb7-6f1a40cc4acd (60882689-f21d-41f0-adb7-6f1a40cc4acd): created successfully Jun 18 22:27:34.702040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba28ef16-563c-4d22-9a35-f2291dba2b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:34.707674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (b93559a4-7b65-4f1b-9af6-78079ec6f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:34.716248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Lock "b'cinder-fc80357d-51d3-4290-b32b-f15f342b548a-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:34.726287 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-92d2a1cf-54fb-4229-bd59-70a3728025b2 tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:34.786040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:34.883892 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:34.884233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Volume volume-fc80357d-51d3-4290-b32b-f15f342b548a is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:34.895717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] deleting rbd volume volume-fc80357d-51d3-4290-b32b-f15f342b548a {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:34.897792 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-89e74310-1bc9-4eb7-a563-9f67d3b10136 req-5cc947ba-6c01-452a-8d77-e8e2bb4779f6 tempest-AttachVolumeTestJSON-223712319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:27:35.361962 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:35.362900 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:27:35.384751 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=67,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:35.397104 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Created reservations ['739aa436-a161-40d3-90f5-5a0fd8698919', 'db0f528c-8880-43f9-94f8-773feff54f86', '065164c9-913b-4899-870a-89729dd31785', 'f559a5fd-53f8-4714-9702-d652cf599a58'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:35.486811 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:35.569518 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:35.647366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:35.666857 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Deleted volume successfully. Jun 18 22:27:35.690460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-60882689-f21d-41f0-adb7-6f1a40cc4acd-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:35.743181 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9859749b-204a-46ae-bb24-bfaa452c1b94 tempest-VolumeRetypeWithoutMigrationTest-1072303322 None] Lock "b'cinder-fc80357d-51d3-4290-b32b-f15f342b548a-delete_volume'" released by "delete_volume" :: held 1.027s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:35.747877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:35.830503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:35.831136 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Volume volume-60882689-f21d-41f0-adb7-6f1a40cc4acd is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:35.841719 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] deleting rbd volume volume-60882689-f21d-41f0-adb7-6f1a40cc4acd {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:36.338348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Created reservations ['8d364d24-56b9-471e-a43d-e93d54619ba2', 'd76e5899-601e-40f6-95a0-9b214264f9a8', '9449c363-48fa-4efc-b477-335287362f11', 'eda6b552-6191-421a-bee5-5e23bdc9282b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:36.444908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:36.526064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:36.617387 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:36.628881 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-89e74310-1bc9-4eb7-a563-9f67d3b10136 req-5cc947ba-6c01-452a-8d77-e8e2bb4779f6 tempest-AttachVolumeTestJSON-223712319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.729s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:27:36.633945 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-89e74310-1bc9-4eb7-a563-9f67d3b10136 req-5cc947ba-6c01-452a-8d77-e8e2bb4779f6 tempest-AttachVolumeTestJSON-223712319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aba020c7-b736-46ee-a1d6-be5789623a04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'aba020c7-b736-46ee-a1d6-be5789623a04', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:27:36.670952 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Deleted volume successfully. Jun 18 22:27:36.736927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-079dd517-1f82-4a44-a906-51919b7cfe7e tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-60882689-f21d-41f0-adb7-6f1a40cc4acd-delete_volume'" released by "delete_volume" :: held 1.046s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:36.757736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-89e74310-1bc9-4eb7-a563-9f67d3b10136 req-5cc947ba-6c01-452a-8d77-e8e2bb4779f6 tempest-AttachVolumeTestJSON-223712319 None] Connection info returned from driver {'name': 'volumes/volume-aba020c7-b736-46ee-a1d6-be5789623a04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aba020c7-b736-46ee-a1d6-be5789623a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '042dd87e-69ec-476f-b181-d767be2fe723'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:27:36.874564 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-89e74310-1bc9-4eb7-a563-9f67d3b10136 req-5cc947ba-6c01-452a-8d77-e8e2bb4779f6 tempest-AttachVolumeTestJSON-223712319 None] attachment_update completed successfully. Jun 18 22:27:37.331164 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:37.366713 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (29ad6c12-b0c8-44fc-a83c-c2b30734c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:37.386267 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7112ace7-c2cd-401d-85fb-82a0b019d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.432432 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7112ace7-c2cd-401d-85fb-82a0b019d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541765728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:37Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.444493 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe42bbe-b31f-4ef6-93c6-20a2f843a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.449427 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe42bbe-b31f-4ef6-93c6-20a2f843a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.455188 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceaf838-3771-47b0-9e2a-852c1993cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.460439 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceaf838-3771-47b0-9e2a-852c1993cd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0', 'volume_name': 'volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.465651 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28be687-bc47-4fba-b392-d6d1fed02e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.470312 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28be687-bc47-4fba-b392-d6d1fed02e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.475496 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65450b02-9704-4ae9-8b3f-9f78a69e6e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.478754 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Volume bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0', 'volume_size': 1} Jun 18 22:27:37.479308 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] creating volume 'volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:37.480251 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:37.572190 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:37.572775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:37.576908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65450b02-9704-4ae9-8b3f-9f78a69e6e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.588193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1fb1db-b722-4cb2-9b00-b3f59074ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:37.608367 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Volume volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0 (bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0): created successfully Jun 18 22:27:37.615876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1fb1db-b722-4cb2-9b00-b3f59074ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:37.627664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (29ad6c12-b0c8-44fc-a83c-c2b30734c696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:37.649356 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9d638a44-fe65-4b9e-b2d3-11e58b31e85a tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:38.651694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:38.705918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:38.855904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:38.856774 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Volume volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:38.862666 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] deleting rbd volume volume-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:39.312177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Created reservations ['57296bc6-750e-4a02-b5b5-2a145ebb7587', 'c4469242-355a-4876-8b5e-20bcd1c036d3', 'ba36fd5f-cc4d-43fa-88e2-b16ce06847ae', '9e34d863-a6e3-4002-86ab-ee9dc1626e82'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:39.328952 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=35,cinder:SELECT=53,cinder:DELETE=3,cinder:INSERT=9 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:39.455839 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:39.539893 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:39.615272 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:39.629198 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Deleted volume successfully. Jun 18 22:27:39.662900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a53a2df8-0931-4b0d-b14d-26514307ecd6 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-bb7dd1f1-42b7-4f49-9fda-ffcf5e436ee0-delete_volume'" released by "delete_volume" :: held 1.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:40.585307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:40.626443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (050bde56-7ad7-4896-8ac5-76c117b6d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:40.642754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d80314-431a-4542-9407-4821e3d53cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.680701 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d80314-431a-4542-9407-4821e3d53cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1359545147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e626576b-4356-4d0f-8279-17bcbb24559b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:41Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.692434 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388f942b-aa9e-42ae-9832-e8bbaec2aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.706241 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388f942b-aa9e-42ae-9832-e8bbaec2aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.716232 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554f65de-8dc0-464b-a9aa-bb9c646c6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.737756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554f65de-8dc0-464b-a9aa-bb9c646c6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e626576b-4356-4d0f-8279-17bcbb24559b', 'volume_name': 'volume-e626576b-4356-4d0f-8279-17bcbb24559b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.742948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe652f6a-6be1-42f6-8714-4a6c77b80138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.747327 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe652f6a-6be1-42f6-8714-4a6c77b80138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.775294 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445942f-b873-4b5e-8fd4-ee4847955a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.778537 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Volume e626576b-4356-4d0f-8279-17bcbb24559b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e626576b-4356-4d0f-8279-17bcbb24559b', 'volume_size': 1} Jun 18 22:27:40.779103 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] creating volume 'volume-e626576b-4356-4d0f-8279-17bcbb24559b' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:40.780251 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:40.913631 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:40.914679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:40.920529 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445942f-b873-4b5e-8fd4-ee4847955a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e626576b-4356-4d0f-8279-17bcbb24559b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.935391 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179daacb-b797-420e-a0b1-3f6f0a3a3e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:40.975991 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Volume volume-e626576b-4356-4d0f-8279-17bcbb24559b (e626576b-4356-4d0f-8279-17bcbb24559b): created successfully Jun 18 22:27:40.980038 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179daacb-b797-420e-a0b1-3f6f0a3a3e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:40.992794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (050bde56-7ad7-4896-8ac5-76c117b6d442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:41.017611 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-26a4ab35-bd1a-495e-ba87-ba767ffcde14 tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:41.940738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-e626576b-4356-4d0f-8279-17bcbb24559b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:42.007827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:42.108507 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:42.109544 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Volume volume-e626576b-4356-4d0f-8279-17bcbb24559b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:42.123904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] deleting rbd volume volume-e626576b-4356-4d0f-8279-17bcbb24559b {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:42.517474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Created reservations ['f288b760-afb4-4175-bfb4-d3986b7212c0', 'c92d7095-d682-4a1e-9374-1ca8c4a15f2f', '83ef6c9a-330a-4fc4-a1d5-31de0a636eaa', '2f03325a-cc2e-4624-ba01-3342f623a266'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:42.610665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:42.678340 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:42.748149 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:42.756718 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Deleted volume successfully. Jun 18 22:27:42.782735 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cec165dd-554e-4b65-b1d9-a958e0b5c472 tempest-VolumesActionsTest-206417076 None] Lock "b'cinder-e626576b-4356-4d0f-8279-17bcbb24559b-delete_volume'" released by "delete_volume" :: held 0.842s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:43.870947 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:43.913824 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (6c084095-7b5d-4dd7-b297-7273e8ffab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:43.934187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090247b5-3db4-4be3-947f-141efb96606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:43.974687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090247b5-3db4-4be3-947f-141efb96606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-127848233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f2f8386-afed-4d57-91ae-e9f461daaa2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e29d31b0974eeebe8ef48f0de23582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:44Z,use_quota=True,user_id='dcd1462ff001498e8776b711e121817f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:43.987379 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9b5f29-d45e-40ab-adac-22feb5282719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:43.998670 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9b5f29-d45e-40ab-adac-22feb5282719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:44.010883 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7f70f3-b975-4d1b-a7f8-bddd5b2292eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:44.026584 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7f70f3-b975-4d1b-a7f8-bddd5b2292eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2f8386-afed-4d57-91ae-e9f461daaa2e', 'volume_name': 'volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:44.044835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c8d0b-de51-4604-abb7-b4a154815eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:44.049121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c8d0b-de51-4604-abb7-b4a154815eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:44.054228 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42dc31-b64e-4e15-8543-064650536800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:44.055455 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Volume 4f2f8386-afed-4d57-91ae-e9f461daaa2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e', 'volume_size': 1} Jun 18 22:27:44.056047 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] creating volume 'volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:44.057011 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:44.145606 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:44.145989 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:44.150431 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42dc31-b64e-4e15-8543-064650536800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:44.159731 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cdfa83-6541-4062-9150-dc21e5c86440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:44.181818 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Volume volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e (4f2f8386-afed-4d57-91ae-e9f461daaa2e): created successfully Jun 18 22:27:44.186875 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cdfa83-6541-4062-9150-dc21e5c86440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:44.200488 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Flow 'volume_create_manager' (6c084095-7b5d-4dd7-b297-7273e8ffab0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:44.211786 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=53,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:44.235630 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-692ff40a-eeca-4652-9e9d-c2936011e692 tempest-VolumesActionsTest-584218559 None] Created volume successfully. Jun 18 22:27:45.286526 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:45.351160 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (c01a01b1-cbb8-4500-92b6-88c0bf949fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:45.363036 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214dd7f8-3a7f-4373-bdf0-cc2797a46282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.414217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214dd7f8-3a7f-4373-bdf0-cc2797a46282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1208030473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=907d8149-14be-4b3c-870b-c4b617c83479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6c943410914eda8c1e667ce13923d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:45Z,use_quota=True,user_id='583c280b393c4ac6814623966146eb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.427500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492d3e2b-3a20-444d-8ece-db5ad1a63327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.450768 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492d3e2b-3a20-444d-8ece-db5ad1a63327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.462083 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605d09b3-9d9b-42ba-9028-36c11c36461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.467519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605d09b3-9d9b-42ba-9028-36c11c36461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907d8149-14be-4b3c-870b-c4b617c83479', 'volume_name': 'volume-907d8149-14be-4b3c-870b-c4b617c83479', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.485368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23f10b-ebd8-436c-a761-244c62101c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.503256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23f10b-ebd8-436c-a761-244c62101c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.516359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d50e01-679b-4182-98a4-dceb071c8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.519393 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Volume 907d8149-14be-4b3c-870b-c4b617c83479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907d8149-14be-4b3c-870b-c4b617c83479', 'volume_size': 1} Jun 18 22:27:45.531255 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] creating volume 'volume-907d8149-14be-4b3c-870b-c4b617c83479' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:45.533502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:45.683724 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:45.684101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:45.688538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d50e01-679b-4182-98a4-dceb071c8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907d8149-14be-4b3c-870b-c4b617c83479', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.699325 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b32044d-70ba-40ac-b45d-056cacec069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:45.718538 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-907d8149-14be-4b3c-870b-c4b617c83479 (907d8149-14be-4b3c-870b-c4b617c83479): created successfully Jun 18 22:27:45.722807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b32044d-70ba-40ac-b45d-056cacec069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:45.730240 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (c01a01b1-cbb8-4500-92b6-88c0bf949fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:45.743370 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6311abf3-70d7-4db5-a46a-4fec46d95b7f tempest-VolumesListAdminTestJSON-834471115 None] Created volume successfully. Jun 18 22:27:45.861515 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-4f2f8386-afed-4d57-91ae-e9f461daaa2e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:45.912261 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:45.973088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:45.973541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Volume volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:45.979389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] deleting rbd volume volume-4f2f8386-afed-4d57-91ae-e9f461daaa2e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:46.288965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Created reservations ['8210f6ba-9e49-4e7e-af3e-8a584dfd7e9c', 'c992b6b5-bb72-499b-ae60-a82eccbc2b8a', 'f6caff8a-8f62-4c38-b8e3-bcb8059493d5', 'f85514ba-affd-4c51-9861-6a2f98a8e6e3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:46.366139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:46.416443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:46.459619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:46.464584 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Deleted volume successfully. Jun 18 22:27:46.478797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-02acd77f-b86b-49ee-8752-3fefb84d05ca tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-4f2f8386-afed-4d57-91ae-e9f461daaa2e-delete_volume'" released by "delete_volume" :: held 0.618s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:46.725813 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:46.745806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (541f079c-6b42-4a85-a73b-bdc98d47b312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:46.752120 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d140a6-4caa-49a2-82df-7ef813ac55f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.768494 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d140a6-4caa-49a2-82df-7ef813ac55f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1903493440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd9e68b8-9995-45ed-b60b-4355e9348681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6c943410914eda8c1e667ce13923d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:47Z,use_quota=True,user_id='583c280b393c4ac6814623966146eb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.773751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dd8898-e351-47ce-bd2b-94ac6f704c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.777783 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dd8898-e351-47ce-bd2b-94ac6f704c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.782715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56871007-3ab8-4418-9b39-ca34dae1a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.786745 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56871007-3ab8-4418-9b39-ca34dae1a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9e68b8-9995-45ed-b60b-4355e9348681', 'volume_name': 'volume-cd9e68b8-9995-45ed-b60b-4355e9348681', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.791432 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5301a-307b-4ac0-93f2-53e6e1771817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.795337 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5301a-307b-4ac0-93f2-53e6e1771817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.799922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24980c1b-584e-4946-ac3c-3cf4f5142257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.801055 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Volume cd9e68b8-9995-45ed-b60b-4355e9348681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9e68b8-9995-45ed-b60b-4355e9348681', 'volume_size': 1} Jun 18 22:27:46.801418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] creating volume 'volume-cd9e68b8-9995-45ed-b60b-4355e9348681' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:46.802219 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:46.859855 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:46.860326 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:46.864187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24980c1b-584e-4946-ac3c-3cf4f5142257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9e68b8-9995-45ed-b60b-4355e9348681', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.868664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81224a9-91bd-4d71-bc6c-465c60bf64b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:46.879122 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-cd9e68b8-9995-45ed-b60b-4355e9348681 (cd9e68b8-9995-45ed-b60b-4355e9348681): created successfully Jun 18 22:27:46.882825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81224a9-91bd-4d71-bc6c-465c60bf64b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:46.888571 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (541f079c-6b42-4a85-a73b-bdc98d47b312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:46.897714 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-12274edf-a3e1-4a33-89bb-eae44671b56a tempest-VolumesListAdminTestJSON-834471115 None] Created volume successfully. Jun 18 22:27:47.189517 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:47.257059 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:47.347989 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:47.348567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Volume volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:47.359836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] deleting rbd volume volume-c5faed64-47bd-4c2c-ae24-c5a82bff2970 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:47.361424 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:27:47.361980 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:47.435367 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:47.479243 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:47.672198 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Created reservations ['95383110-424f-42e2-aca9-eba4235b8d2a', 'd498078b-c4e5-4d01-8eb6-ba673168f3b4', 'ef1f90c1-6753-4f9c-a370-43bb9836f916', '8b6c4416-af73-4c35-868e-cd34a31fd09d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:47.734099 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:47.796416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:47.874292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:47.878840 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Deleted volume successfully. Jun 18 22:27:47.904783 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4f669c54-7829-40a2-ac1a-325a2a5e129e tempest-VolumesActionsTest-584218559 None] Lock "b'cinder-c5faed64-47bd-4c2c-ae24-c5a82bff2970-delete_volume'" released by "delete_volume" :: held 0.715s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:48.290954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:48.343987 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (603dc0d2-a65e-4f7a-be6b-4fbb012687c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:48.352833 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b083eda7-75f4-4b78-a60a-b3c49dca1f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.374833 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b083eda7-75f4-4b78-a60a-b3c49dca1f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1570072664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=591a56dd-8466-452e-aeb0-8d083582e23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6c943410914eda8c1e667ce13923d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:48Z,use_quota=True,user_id='583c280b393c4ac6814623966146eb55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.381493 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dac09a-eb0e-495d-85de-58a467ecf541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.385801 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dac09a-eb0e-495d-85de-58a467ecf541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.391629 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8559df-9735-49c1-b899-4e56565457b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.397705 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8559df-9735-49c1-b899-4e56565457b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591a56dd-8466-452e-aeb0-8d083582e23d', 'volume_name': 'volume-591a56dd-8466-452e-aeb0-8d083582e23d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.403501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5dfed8-32fd-4686-9e45-26ad1fc7f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.409388 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5dfed8-32fd-4686-9e45-26ad1fc7f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.416688 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e3300f-7e9b-425a-bd2d-35d8363e11ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.419237 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Volume 591a56dd-8466-452e-aeb0-8d083582e23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591a56dd-8466-452e-aeb0-8d083582e23d', 'volume_size': 1} Jun 18 22:27:48.419795 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] creating volume 'volume-591a56dd-8466-452e-aeb0-8d083582e23d' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:48.420743 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:48.541121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:48.541508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:48.548296 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e3300f-7e9b-425a-bd2d-35d8363e11ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591a56dd-8466-452e-aeb0-8d083582e23d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.557534 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93addca0-0843-4f04-81ad-1289f41c11e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:48.575263 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-591a56dd-8466-452e-aeb0-8d083582e23d (591a56dd-8466-452e-aeb0-8d083582e23d): created successfully Jun 18 22:27:48.583053 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93addca0-0843-4f04-81ad-1289f41c11e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:48.590480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Flow 'volume_create_manager' (603dc0d2-a65e-4f7a-be6b-4fbb012687c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:48.601205 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-faca406b-a17d-4ed6-ad43-b57a1703d815 tempest-VolumesListAdminTestJSON-834471115 None] Created volume successfully. Jun 18 22:27:50.296649 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=34,cinder:SELECT=59,cinder:INSERT=3,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:50.336252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:50.366977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Flow 'volume_create_manager' (9ee8700a-d78f-4c87-86b5-5b6e25c4d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:50.376543 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da18cd82-c244-4e2e-a0ca-0e7341882511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.413026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da18cd82-c244-4e2e-a0ca-0e7341882511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf3ca1a2-545d-4f97-8ebb-ddfddc202d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1973f6b91ac541c89aa7a53d3b7ace60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:50Z,use_quota=True,user_id='0da28cf647e94f1980cb44f1c81bb7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.420937 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13980dca-aa42-41a5-9da8-1ef404458306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.425803 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13980dca-aa42-41a5-9da8-1ef404458306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.432599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de557328-7cfe-4643-a3a3-535613e3f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.442749 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de557328-7cfe-4643-a3a3-535613e3f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3ca1a2-545d-4f97-8ebb-ddfddc202d22', 'volume_name': 'volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.460536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ceab2c-1afd-40d3-b593-5484f7a9c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.467171 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ceab2c-1afd-40d3-b593-5484f7a9c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.475977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3f00b5-ecd6-46c9-913b-366ecede85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.477174 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Volume cf3ca1a2-545d-4f97-8ebb-ddfddc202d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22', 'volume_size': 1} Jun 18 22:27:50.477686 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] creating volume 'volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:50.478367 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:50.587886 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:50.588409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:50.592163 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3f00b5-ecd6-46c9-913b-366ecede85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.596840 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2a2519-68a8-43e9-ac58-320cd6cda846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:50.610146 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Volume volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22 (cf3ca1a2-545d-4f97-8ebb-ddfddc202d22): created successfully Jun 18 22:27:50.615782 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2a2519-68a8-43e9-ac58-320cd6cda846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:50.623638 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Flow 'volume_create_manager' (9ee8700a-d78f-4c87-86b5-5b6e25c4d152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:50.635589 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5f48c4ac-4669-45a0-8019-387870c00ae2 tempest-VolumesListAdminTestJSON-27831262 None] Created volume successfully. Jun 18 22:27:51.602305 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Lock "b'cinder-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:51.659284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:51.737643 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:51.738048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Volume volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:51.750918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] deleting rbd volume volume-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:51.782501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-591a56dd-8466-452e-aeb0-8d083582e23d-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:51.842853 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:51.921345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:51.922070 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-591a56dd-8466-452e-aeb0-8d083582e23d is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:51.926608 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] deleting rbd volume volume-591a56dd-8466-452e-aeb0-8d083582e23d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:52.082368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Created reservations ['388739fe-22cb-4ce8-9718-d50305d3c131', 'e7c2829d-e3f2-4677-9d59-f394b1da749d', '45f6e0a2-fd52-496c-a0c0-1aa46be07640', 'a8fdeb70-4c42-4617-abfb-ca27335d3c1f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:52.152334 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=62,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=9 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:52.180943 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:52.236345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:52.282341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:52.325181 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Deleted volume successfully. Jun 18 22:27:52.374805 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6f2470c0-702a-4650-b917-2d157cfe9065 tempest-VolumesListAdminTestJSON-27831262 None] Lock "b'cinder-cf3ca1a2-545d-4f97-8ebb-ddfddc202d22-delete_volume'" released by "delete_volume" :: held 0.772s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:52.401928 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Created reservations ['70977cff-f729-4ef2-a669-110200dba86d', 'a721c08d-3c86-4c80-8eec-506acea3a48f', 'f3846a75-f7cf-4ba0-a922-e316b5740c06', '8230ed81-0a5d-469f-b354-69ebf9b96c98'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:52.464086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:52.508612 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:52.547289 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:52.551876 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Deleted volume successfully. Jun 18 22:27:52.566530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4d1207b6-1c86-4287-a5aa-cd338ae15abb tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-591a56dd-8466-452e-aeb0-8d083582e23d-delete_volume'" released by "delete_volume" :: held 0.786s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:53.178204 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-cd9e68b8-9995-45ed-b60b-4355e9348681-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:53.223611 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:53.321857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:53.322675 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-cd9e68b8-9995-45ed-b60b-4355e9348681 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:53.329924 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] deleting rbd volume volume-cd9e68b8-9995-45ed-b60b-4355e9348681 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:53.673922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Created reservations ['60dab93f-38ec-4e38-980d-432941f2e8e1', '5e68ed2a-cf1f-472c-a0ce-f4e46f6a6800', 'abd5b46f-7fd9-4c0c-b591-83cb0c910b60', '64dc8507-704b-4205-8b76-e9a4ab53b646'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:53.747547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:53.792647 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:53.854665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:53.872555 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Deleted volume successfully. Jun 18 22:27:53.921992 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c0d320ef-97db-4bbc-9c7c-709e7c76e89b tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-cd9e68b8-9995-45ed-b60b-4355e9348681-delete_volume'" released by "delete_volume" :: held 0.742s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:54.411532 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-907d8149-14be-4b3c-870b-c4b617c83479-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:54.550435 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:54.650553 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:54.651058 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Volume volume-907d8149-14be-4b3c-870b-c4b617c83479 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:54.663011 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] deleting rbd volume volume-907d8149-14be-4b3c-870b-c4b617c83479 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:55.128103 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Created reservations ['2f3a3ff0-7a45-4dbd-acf2-5676a5bcbbbd', '195ee2e2-bb47-4fae-bc13-382910b14177', '38dc1a5d-4b0b-4bd7-ac97-015ba300bd8d', 'bca29c78-bae2-4091-89bf-aa3da56181ad'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:55.218834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:55.327759 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:55.377790 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:55.383410 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Deleted volume successfully. Jun 18 22:27:55.404248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c281a33b-5820-4d0b-87cd-00b2150465fe tempest-VolumesListAdminTestJSON-834471115 None] Lock "b'cinder-907d8149-14be-4b3c-870b-c4b617c83479-delete_volume'" released by "delete_volume" :: held 0.994s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:27:57.702426 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=52,cinder:UPDATE=38,cinder:INSERT=7,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:57.737477 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:27:57.794610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Flow 'volume_create_manager' (90465ccc-dc63-4ec2-903f-46832c42aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:57.810799 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d4f8cf-d241-46e8-a81e-66672a20df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:57.855012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d4f8cf-d241-46e8-a81e-66672a20df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-566845689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce5d1367-330e-48c1-a7a2-e48373b7ba2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af9143a191884663bcdc718ca7b8a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:27:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:27:58Z,use_quota=True,user_id='590f78868fd942e6906cab1b4822bde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:57.872840 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42acf5d0-5d16-4d69-9629-dc93d98ae6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:57.877873 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42acf5d0-5d16-4d69-9629-dc93d98ae6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:57.898981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1def806-2660-4f57-94ff-fab109259343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:57.909216 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1def806-2660-4f57-94ff-fab109259343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5d1367-330e-48c1-a7a2-e48373b7ba2d', 'volume_name': 'volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d', 'volume_size': 2}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:57.918699 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bb428e-7215-4632-890a-508114ba25ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:57.932334 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bb428e-7215-4632-890a-508114ba25ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:57.953770 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e8373e-7846-45ca-958d-d6844b284738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:57.955033 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Volume ce5d1367-330e-48c1-a7a2-e48373b7ba2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d', 'volume_size': 2} Jun 18 22:27:57.955468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] creating volume 'volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:27:57.956254 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:58.087195 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:27:58.087652 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:27:58.091483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e8373e-7846-45ca-958d-d6844b284738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d', 'volume_size': 2}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:58.103870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d639d084-b19c-4fe7-8f7a-c8c7adeb541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:27:58.128155 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Volume volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d (ce5d1367-330e-48c1-a7a2-e48373b7ba2d): created successfully Jun 18 22:27:58.132460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d639d084-b19c-4fe7-8f7a-c8c7adeb541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:27:58.144804 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Flow 'volume_create_manager' (90465ccc-dc63-4ec2-903f-46832c42aeea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:27:58.158787 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b2c798c2-9faf-456d-b3ca-e407f1cdc0cb tempest-VolumesCloneNegativeTest-1417991731 None] Created volume successfully. Jun 18 22:27:59.065324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Lock "b'cinder-ce5d1367-330e-48c1-a7a2-e48373b7ba2d-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:27:59.155217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:59.244946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:27:59.245419 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Volume volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:27:59.253796 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] deleting rbd volume volume-ce5d1367-330e-48c1-a7a2-e48373b7ba2d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:27:59.721468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Created reservations ['40b71506-4e34-493c-8b54-cb8f057eaccc', 'b7ac0372-dd61-4a0c-b99b-b16bd49f2c18', '8a467b31-8f5b-45da-877a-adcb49693275', '59e066bb-fd3e-4b0a-a480-f111b45233e9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:27:59.826608 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:59.878613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:27:59.969575 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:27:59.976842 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Deleted volume successfully. Jun 18 22:27:59.999212 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-aead6edb-30ad-4c82-805f-e18bf02877b7 tempest-VolumesCloneNegativeTest-1417991731 None] Lock "b'cinder-ce5d1367-330e-48c1-a7a2-e48373b7ba2d-delete_volume'" released by "delete_volume" :: held 0.934s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:28:05.172645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:28:05.196911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Flow 'volume_create_manager' (bb3a64b5-86ca-42f5-8798-5af52eab2b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:05.205674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46675f00-61ab-403e-9f56-090103149c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.227795 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46675f00-61ab-403e-9f56-090103149c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1747694402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e70ab454-f92e-4fcd-9cbc-9df276d4f722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a9dc50952e4973a4bc26a098eaccff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:28:05Z,use_quota=True,user_id='2b6d36bff3c94a1eb74330d86296516d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.233417 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5196b028-a76f-4bd8-9678-009466b440da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.237657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5196b028-a76f-4bd8-9678-009466b440da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.243910 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9809a0f9-2bdd-40fb-8686-b7ac0e727159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.248358 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9809a0f9-2bdd-40fb-8686-b7ac0e727159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70ab454-f92e-4fcd-9cbc-9df276d4f722', 'volume_name': 'volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.253548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f8bc77-a4bf-40c0-a759-dadeb14702f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.257697 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f8bc77-a4bf-40c0-a759-dadeb14702f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.262713 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f153d8c6-1b30-411c-b8de-fb63bfafb227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.264069 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Volume e70ab454-f92e-4fcd-9cbc-9df276d4f722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722', 'volume_size': 1} Jun 18 22:28:05.264664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] creating volume 'volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:28:05.265643 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:05.372362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:28:05.372758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:28:05.377142 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f153d8c6-1b30-411c-b8de-fb63bfafb227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.385835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c12247e-7d26-44ed-af75-56cb49d3a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:05.408441 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Volume volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722 (e70ab454-f92e-4fcd-9cbc-9df276d4f722): created successfully Jun 18 22:28:05.417893 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c12247e-7d26-44ed-af75-56cb49d3a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:05.432833 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Flow 'volume_create_manager' (bb3a64b5-86ca-42f5-8798-5af52eab2b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:05.447324 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-90766fae-5cac-4d0f-842e-1bf006961750 tempest-VolumesTransfersV355Test-321513923 None] Created volume successfully. Jun 18 22:28:07.305841 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a96b6a54-8250-4bc7-83f3-157223477293 tempest-VolumesTransfersV355Test-628735472 None] Transfer volume completed successfully. Jun 18 22:28:08.153618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Lock "b'cinder-e70ab454-f92e-4fcd-9cbc-9df276d4f722-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:28:08.171980 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:08.225174 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:08.293682 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:28:08.294720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Volume volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:28:08.302396 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] deleting rbd volume volume-e70ab454-f92e-4fcd-9cbc-9df276d4f722 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:28:08.619150 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Created reservations ['848e0fd1-fcbd-4d6c-a496-8383c675fef7', '7c960c75-417b-47aa-b3b1-7dabaf030dcd', 'a11df79c-b724-4bb1-b350-2ee1dcdbbf06', '4d053ba9-7eb4-4428-af3d-94e3efc42a1d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:28:08.707286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:08.764207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:08.849117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:08.853739 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Deleted volume successfully. Jun 18 22:28:08.878099 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f91a8c06-2da8-48e6-8b7d-9c41a3e933d6 tempest-VolumesTransfersV355Test-19762344 None] Lock "b'cinder-e70ab454-f92e-4fcd-9cbc-9df276d4f722-delete_volume'" released by "delete_volume" :: held 0.724s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:28:09.843162 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:28:09.890003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Flow 'volume_create_manager' (fc9082a0-bec9-4aee-afe8-fedd914111a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:09.898551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dbf47e-0ea2-4ccc-81e4-50b61068fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:09.940186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dbf47e-0ea2-4ccc-81e4-50b61068fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-270608035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e04cb729-5059-4ece-9ce7-69e403ad1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a9dc50952e4973a4bc26a098eaccff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:28:10Z,use_quota=True,user_id='2b6d36bff3c94a1eb74330d86296516d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:09.945841 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300554a3-96bb-455c-a988-9e0fd8cca77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:09.950283 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300554a3-96bb-455c-a988-9e0fd8cca77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:09.957081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863aef59-6da9-4711-a2d1-f0beaa4c62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:09.964932 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863aef59-6da9-4711-a2d1-f0beaa4c62f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04cb729-5059-4ece-9ce7-69e403ad1df8', 'volume_name': 'volume-e04cb729-5059-4ece-9ce7-69e403ad1df8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:09.972021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2336b5-fe96-447a-9b84-1f485d2e5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:09.976467 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2336b5-fe96-447a-9b84-1f485d2e5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:09.982186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a9919-2063-4107-83a6-00a50e1d0cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:09.983952 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Volume e04cb729-5059-4ece-9ce7-69e403ad1df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04cb729-5059-4ece-9ce7-69e403ad1df8', 'volume_size': 1} Jun 18 22:28:09.984738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] creating volume 'volume-e04cb729-5059-4ece-9ce7-69e403ad1df8' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:28:09.986588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:10.087661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:28:10.088045 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:28:10.092264 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70a9919-2063-4107-83a6-00a50e1d0cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04cb729-5059-4ece-9ce7-69e403ad1df8', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:10.099400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be313c0c-97ae-4467-95cf-a66cc4e9be6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:10.119732 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Volume volume-e04cb729-5059-4ece-9ce7-69e403ad1df8 (e04cb729-5059-4ece-9ce7-69e403ad1df8): created successfully Jun 18 22:28:10.124011 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be313c0c-97ae-4467-95cf-a66cc4e9be6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:10.130324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Flow 'volume_create_manager' (fc9082a0-bec9-4aee-afe8-fedd914111a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:10.140503 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-dc6ff56c-ed67-446b-9c10-c129c7f79dee tempest-VolumesTransfersV355Test-321513923 None] Created volume successfully. Jun 18 22:28:11.328861 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Lock "b'cinder-e04cb729-5059-4ece-9ce7-69e403ad1df8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:28:11.374010 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:11.461918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:28:11.462661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Volume volume-e04cb729-5059-4ece-9ce7-69e403ad1df8 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:28:11.477201 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] deleting rbd volume volume-e04cb729-5059-4ece-9ce7-69e403ad1df8 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:28:11.835950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Created reservations ['1ee2769d-56c5-4d50-904d-ae2ce94b44cd', '7690e763-af38-4e14-af17-901063013524', '4f12a935-e327-4b04-9534-98b39b80842a', '4e309c40-2ac6-4614-afb0-1aa8349d3ead'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:28:11.969755 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:12.074545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:12.142233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:12.147354 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Deleted volume successfully. Jun 18 22:28:12.174416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8813411f-5dd3-456c-85bb-7c798921fd37 tempest-VolumesTransfersV355Test-19762344 None] Lock "b'cinder-e04cb729-5059-4ece-9ce7-69e403ad1df8-delete_volume'" released by "delete_volume" :: held 0.846s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:28:18.935786 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:28:18.961815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Flow 'volume_create_manager' (0cea7d25-2834-4552-9b89-04b93fd81f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:18.968374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaa216b-6f88-4555-827b-41862d37ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:18.994163 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaa216b-6f88-4555-827b-41862d37ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-233017020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d679906-0b86-48a6-98f4-c05d90ab3c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2657072934844f9952c9c5e6b383d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:28:19Z,use_quota=True,user_id='8bf0e99cc3bf40f29a8c1e6023718c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.002202 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc87b97-1739-49dd-adaf-ba5dff485605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:19.009718 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc87b97-1739-49dd-adaf-ba5dff485605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.017727 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6cdf21-a397-4ce5-99dc-84e97436a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:19.024569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6cdf21-a397-4ce5-99dc-84e97436a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d679906-0b86-48a6-98f4-c05d90ab3c0c', 'volume_name': 'volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.039360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c8c32d-179d-4c1a-900d-230b9c0046f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:19.045392 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c8c32d-179d-4c1a-900d-230b9c0046f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.050927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bf58b7-ff9f-46b6-acba-cc93b3497d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:19.052339 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Volume 1d679906-0b86-48a6-98f4-c05d90ab3c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c', 'volume_size': 1} Jun 18 22:28:19.052742 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] creating volume 'volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:28:19.053533 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:19.144541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:28:19.145158 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:28:19.159021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bf58b7-ff9f-46b6-acba-cc93b3497d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.164097 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b439de5-8987-4919-afe9-97f0026aca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:19.176081 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Volume volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c (1d679906-0b86-48a6-98f4-c05d90ab3c0c): created successfully Jun 18 22:28:19.181244 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b439de5-8987-4919-afe9-97f0026aca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:19.187248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Flow 'volume_create_manager' (0cea7d25-2834-4552-9b89-04b93fd81f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:19.201380 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-040dd853-220b-4162-9ee6-e54873ababad tempest-VolumesNegativeTest-1472555787 None] Created volume successfully. Jun 18 22:28:29.660817 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=50,cinder:DELETE=6,cinder:UPDATE=30,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:39.664201 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=31,cinder:INSERT=2,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:41.788184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Lock "b'cinder-1d679906-0b86-48a6-98f4-c05d90ab3c0c-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:28:41.893252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:41.974559 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:28:41.974973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Volume volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:28:41.986111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] deleting rbd volume volume-1d679906-0b86-48a6-98f4-c05d90ab3c0c {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:28:42.358784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Created reservations ['7fc2c978-4e94-448e-a921-13587a5d1020', '3ea777ae-aec5-426d-bc47-94e744a87d01', 'bc132101-d003-4c2c-be50-c7fb5dc66c45', 'd3b42ef0-0ebc-4ca2-ba3e-4fb2468e6053'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:28:42.431930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:42.513410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:42.582541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:42.588782 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Deleted volume successfully. Jun 18 22:28:42.608192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6b892067-f868-4399-bc09-edd0e043f7d6 tempest-VolumesNegativeTest-1472555787 None] Lock "b'cinder-1d679906-0b86-48a6-98f4-c05d90ab3c0c-delete_volume'" released by "delete_volume" :: held 0.820s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:28:47.358210 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:28:47.358913 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:47.422494 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:47.485584 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:51.889205 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:28:51.963202 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Flow 'volume_create_manager' (3a8cbb02-ce41-4b3f-910b-26b3ad875515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:51.982356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8376c0c5-4c2f-4c6b-ae0f-6428755f69ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.044083 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8376c0c5-4c2f-4c6b-ae0f-6428755f69ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-753559515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3234a1da-ebc0-4352-ba53-c1031814fb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55b24bd3f4842329c7ad09562be1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:28:52Z,use_quota=True,user_id='38ba41d0a25b47d19a21a0b225b725a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.051232 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfacc31-7c38-48d1-8a41-149b8bb1c8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.061256 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfacc31-7c38-48d1-8a41-149b8bb1c8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.068791 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b20128-a397-428c-b33d-e2b18229b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.074946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b20128-a397-428c-b33d-e2b18229b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3234a1da-ebc0-4352-ba53-c1031814fb65', 'volume_name': 'volume-3234a1da-ebc0-4352-ba53-c1031814fb65', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.081864 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b4c6da-64de-4e4b-a888-3eb3621ed952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.087585 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b4c6da-64de-4e4b-a888-3eb3621ed952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.094599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02a2015-9fbf-4f27-ae66-e59c66dfe555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.095855 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume 3234a1da-ebc0-4352-ba53-c1031814fb65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3234a1da-ebc0-4352-ba53-c1031814fb65', 'volume_size': 1} Jun 18 22:28:52.096403 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] creating volume 'volume-3234a1da-ebc0-4352-ba53-c1031814fb65' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:28:52.097417 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:52.180483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:28:52.181546 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:28:52.186068 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02a2015-9fbf-4f27-ae66-e59c66dfe555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3234a1da-ebc0-4352-ba53-c1031814fb65', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.197303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80e50f8-9dd8-4c13-bb65-54fd1c118ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:52.233513 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume volume-3234a1da-ebc0-4352-ba53-c1031814fb65 (3234a1da-ebc0-4352-ba53-c1031814fb65): created successfully Jun 18 22:28:52.237299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80e50f8-9dd8-4c13-bb65-54fd1c118ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:52.257471 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Flow 'volume_create_manager' (3a8cbb02-ce41-4b3f-910b-26b3ad875515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:52.285705 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-044b3426-ef73-4c78-b372-701f208d44da tempest-VolumeQuotasAdminTestJSON-1281473364 None] Created volume successfully. Jun 18 22:28:52.564666 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-475386d1-9bec-4399-911f-332dc132e4d0 req-acef96fc-c6e3-41e1-a818-640a2de264c9 tempest-AttachVolumeTestJSON-223712319 None] Terminate volume connection completed successfully. Jun 18 22:28:52.565454 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-475386d1-9bec-4399-911f-332dc132e4d0 req-acef96fc-c6e3-41e1-a818-640a2de264c9 tempest-AttachVolumeTestJSON-223712319 None] Deleting attachment 042dd87e-69ec-476f-b181-d767be2fe723. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:28:53.113168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Lock "b'cinder-3234a1da-ebc0-4352-ba53-c1031814fb65-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:28:53.176338 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:53.313329 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:28:53.315196 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume volume-3234a1da-ebc0-4352-ba53-c1031814fb65 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:28:53.327027 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] deleting rbd volume volume-3234a1da-ebc0-4352-ba53-c1031814fb65 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:28:53.723842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Created reservations ['f53cb8cf-84a3-443f-8315-888de6414baa', '921bb3db-62cc-4dc2-b415-2c2988d47575', 'aa417dc7-77b6-4354-88d9-f0e38b7c8e4d', '2d317403-c52b-46b1-8289-8cd64e1f3574'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:28:53.781359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:53.850555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:53.929925 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:53.939937 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Deleted volume successfully. Jun 18 22:28:53.964825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d3d7961-44cb-485d-9f47-548fe5b4775c tempest-VolumeQuotasAdminTestJSON-1281473364 None] Lock "b'cinder-3234a1da-ebc0-4352-ba53-c1031814fb65-delete_volume'" released by "delete_volume" :: held 0.851s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:28:54.785203 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:28:54.842026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Flow 'volume_create_manager' (d8abd54e-701d-45b1-9193-e09c7e835105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:54.854557 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822d6662-e597-4885-af02-0cc4bba9e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:54.878536 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822d6662-e597-4885-af02-0cc4bba9e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-559731631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b6c22cc-90c8-4353-b3f1-95a5989cf055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55b24bd3f4842329c7ad09562be1b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:28:55Z,use_quota=True,user_id='38ba41d0a25b47d19a21a0b225b725a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:54.884572 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcba921-34e5-4156-95e4-91ace58dd91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:54.891116 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcba921-34e5-4156-95e4-91ace58dd91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:54.897953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4f66b-a417-47cd-b7bc-a82293fd49ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:54.903097 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4f66b-a417-47cd-b7bc-a82293fd49ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6c22cc-90c8-4353-b3f1-95a5989cf055', 'volume_name': 'volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:54.908026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031df8d-1bd3-4641-837b-2b2be7544c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:54.912024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031df8d-1bd3-4641-837b-2b2be7544c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:54.917051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aa038e-9021-4d1a-8371-b5f2215277f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:54.918353 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume 4b6c22cc-90c8-4353-b3f1-95a5989cf055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055', 'volume_size': 1} Jun 18 22:28:54.918913 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] creating volume 'volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:28:54.919809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:55.006185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:28:55.007891 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:28:55.014384 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aa038e-9021-4d1a-8371-b5f2215277f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:55.019355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89808012-b025-47d0-b3e3-ae091f3318d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:28:55.036402 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Volume volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055 (4b6c22cc-90c8-4353-b3f1-95a5989cf055): created successfully Jun 18 22:28:55.042922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89808012-b025-47d0-b3e3-ae091f3318d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:28:55.048519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Flow 'volume_create_manager' (d8abd54e-701d-45b1-9193-e09c7e835105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:28:55.059959 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-29c1ff86-4c95-4e80-9b2b-0482f0ef4bab tempest-VolumeQuotasAdminTestJSON-1281473364 None] Created volume successfully. Jun 18 22:28:56.759232 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-41c66b2a-606d-4b1e-87f2-073dbeb0c024 tempest-VolumeQuotasAdminTestJSON-2082130472 None] Transfer volume completed successfully. Jun 18 22:28:57.300267 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Lock "b'cinder-4b6c22cc-90c8-4353-b3f1-95a5989cf055-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:28:57.354976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:57.434435 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:28:57.435147 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Volume volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:28:57.445317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] deleting rbd volume volume-4b6c22cc-90c8-4353-b3f1-95a5989cf055 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:28:57.825129 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Created reservations ['6a402ab1-d73c-4b75-b8bc-0b6472208cd9', 'f40e7f26-86a3-4b06-bd06-e4bacf5fa9a1', 'f55a83dc-16ea-477a-8129-f9efb1510ee9', 'f6062d27-ed3d-4513-bfd1-7b43b831899e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:28:57.931040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:58.022322 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:28:58.100141 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:28:58.106173 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Deleted volume successfully. Jun 18 22:28:58.124004 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8ef92db2-2e58-4f13-a63a-8fafb55c43e5 tempest-VolumeQuotasAdminTestJSON-119290116 None] Lock "b'cinder-4b6c22cc-90c8-4353-b3f1-95a5989cf055-delete_volume'" released by "delete_volume" :: held 0.824s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:05.590288 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:05.645819 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Flow 'volume_create_manager' (6a2f4542-3762-4f92-8059-c2c42c6affc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:05.655801 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35508826-bf03-4157-a292-ef2e605d1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.662189 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=48,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:05.675668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35508826-bf03-4157-a292-ef2e605d1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1700419743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02c04b98-1c65-4be0-b8c2-b2bd8532e97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6865d53cbdb64eb7b333fa36daffe0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:06Z,use_quota=True,user_id='46ec3a39c0ce4199aa6099ca8cca6b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.681785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ad6fb0-6b43-4d8d-a3c2-a093abc01992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.685926 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ad6fb0-6b43-4d8d-a3c2-a093abc01992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.691614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db108892-d63e-46a4-9cf5-55f5a15035c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.697479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db108892-d63e-46a4-9cf5-55f5a15035c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c04b98-1c65-4be0-b8c2-b2bd8532e97a', 'volume_name': 'volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.719397 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7bd5e3-bdd1-4596-bc25-8cff5bf48a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.729517 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7bd5e3-bdd1-4596-bc25-8cff5bf48a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.740997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5fd24-5efe-44ff-be7b-5b567120e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.743776 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Volume 02c04b98-1c65-4be0-b8c2-b2bd8532e97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a', 'volume_size': 1} Jun 18 22:29:05.744530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] creating volume 'volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:29:05.746569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:05.853483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:05.853974 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:05.859465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5fd24-5efe-44ff-be7b-5b567120e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.866463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d66f9-3b96-4936-8b5a-84cf74ce8bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:05.890862 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Volume volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a (02c04b98-1c65-4be0-b8c2-b2bd8532e97a): created successfully Jun 18 22:29:05.896084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4d66f9-3b96-4936-8b5a-84cf74ce8bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:05.912868 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Flow 'volume_create_manager' (6a2f4542-3762-4f92-8059-c2c42c6affc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:05.970346 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9f0b85a2-2184-44d7-999a-328adb57efbb tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Created volume successfully. Jun 18 22:29:08.468104 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Lock "b'cinder-02c04b98-1c65-4be0-b8c2-b2bd8532e97a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:08.503676 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=60,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:08.563086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:08.674126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:08.675662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Volume volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:08.686799 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] deleting rbd volume volume-02c04b98-1c65-4be0-b8c2-b2bd8532e97a {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:09.124917 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Created reservations ['97b17651-5ee3-4408-9c6e-e10063e282f7', '01261eba-78f2-4b19-8567-cf6d8dd0ee2d', '62f99b16-f8d0-4829-a594-6a059fada351', '2b20aa7a-39a8-4562-9dd5-03716112014c'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:09.205412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:09.258160 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:09.318111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:09.322416 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Deleted volume successfully. Jun 18 22:29:09.341449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-28ca659e-c879-4c3c-8c03-21f4fd4f3b31 tempest-VolumeQuotasNegativeTestJSON-1810936578 None] Lock "b'cinder-02c04b98-1c65-4be0-b8c2-b2bd8532e97a-delete_volume'" released by "delete_volume" :: held 0.873s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:15.252678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:15.272538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Flow 'volume_create_manager' (02a2478f-ea32-413e-a9c8-a7ce3d675f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:15.279613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154eb9d3-5e6c-4637-9bd7-23f4ffda4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.299557 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154eb9d3-5e6c-4637-9bd7-23f4ffda4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-855763760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc3eb8f7-f961-4014-bfac-67e75d20b0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0311c9054bd42d59c825ea080ca6213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:15Z,use_quota=True,user_id='45fbd6ce9c57450196ecfc2e15a29c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.304951 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98456e3-e5a1-4831-9af3-a41180825afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.309213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98456e3-e5a1-4831-9af3-a41180825afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.314710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc289eab-fbe8-4d96-a6ad-438843130ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.319006 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc289eab-fbe8-4d96-a6ad-438843130ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3eb8f7-f961-4014-bfac-67e75d20b0b1', 'volume_name': 'volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.324087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8392ad92-6043-4baf-8ffc-3bafee999ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.328082 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8392ad92-6043-4baf-8ffc-3bafee999ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.332890 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788fd78c-7549-4e1d-872f-71cf0f73dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.333992 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Volume bc3eb8f7-f961-4014-bfac-67e75d20b0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1', 'volume_size': 1} Jun 18 22:29:15.334382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] creating volume 'volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:29:15.335147 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:15.401981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:15.402507 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:15.406825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788fd78c-7549-4e1d-872f-71cf0f73dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.412045 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5769b-18bd-44e7-ad68-a600425ea0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:15.423872 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Volume volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1 (bc3eb8f7-f961-4014-bfac-67e75d20b0b1): created successfully Jun 18 22:29:15.428857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5769b-18bd-44e7-ad68-a600425ea0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:15.435676 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Flow 'volume_create_manager' (02a2478f-ea32-413e-a9c8-a7ce3d675f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:15.447994 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4f803681-019d-4c3c-8d36-36a17a5dd8e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Created volume successfully. Jun 18 22:29:16.540499 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3bc8828b-5e67-494d-85ef-41186c7f477d tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:17.537531 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3bc8828b-5e67-494d-85ef-41186c7f477d tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Create snapshot completed successfully Jun 18 22:29:18.998495 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f72934b9-3dbe-416b-8935-533dc8114eb7 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Lock "b'cinder-12306d23-067b-4348-9f99-c1c496b793a4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:19.000523 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f72934b9-3dbe-416b-8935-533dc8114eb7 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:19.529607 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-f72934b9-3dbe-416b-8935-533dc8114eb7 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Created reservations ['f9da85ef-228a-4dfb-a029-2befda4963a6', '36c881e3-f762-48ce-be56-948982aca571', '1d8cfe73-1f25-4274-850a-a37027a5900e', '14085864-608d-490c-afcd-166ca04ef799'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:19.577349 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f72934b9-3dbe-416b-8935-533dc8114eb7 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Delete snapshot completed successfully. Jun 18 22:29:19.589237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f72934b9-3dbe-416b-8935-533dc8114eb7 tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Lock "b'cinder-12306d23-067b-4348-9f99-c1c496b793a4-delete_snapshot'" released by "delete_snapshot" :: held 0.591s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:20.145043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Lock "b'cinder-bc3eb8f7-f961-4014-bfac-67e75d20b0b1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:20.216377 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:20.289890 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:20.290337 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Volume volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:20.296473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] deleting rbd volume volume-bc3eb8f7-f961-4014-bfac-67e75d20b0b1 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:20.565024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Created reservations ['e910cba9-e2c8-443d-bbe4-e58e51fad25b', 'd8f37253-a93d-49ff-b11f-141cb07c7b0d', 'daffd336-95c8-465e-a230-a85a64175c02', '645bb1f8-a2ec-487e-a4eb-c297b4d00d0a'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:20.615787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:20.662937 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:20.712608 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:20.723103 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Deleted volume successfully. Jun 18 22:29:20.737037 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-f722d051-775b-44b5-bef7-36a2ad4eb75c tempest-VolumeSnapshotQuotasNegativeTestJSON-379752770 None] Lock "b'cinder-bc3eb8f7-f961-4014-bfac-67e75d20b0b1-delete_volume'" released by "delete_volume" :: held 0.592s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:30.727139 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=42,cinder:UPDATE=18,cinder:INSERT=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:31.698213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:31.733963 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Flow 'volume_create_manager' (6234e7e5-a6f9-48da-b3c9-64d18bc88116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:31.743747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2df7f32-0d22-4227-b627-eedd7a9c2e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.764107 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2df7f32-0d22-4227-b627-eedd7a9c2e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-875108827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79f93db4-df1f-417e-9ea1-bb99e038f3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1be2f5441fe54817b84b1ee108b9f6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:32Z,use_quota=True,user_id='bde8bc8327394bcc80cb60633c4215a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.770811 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7322170-60c3-4796-bb76-7adb3625f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.776633 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7322170-60c3-4796-bb76-7adb3625f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.783380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09bd81b-0fa1-42d4-b5a6-31c8134373f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.789229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09bd81b-0fa1-42d4-b5a6-31c8134373f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f93db4-df1f-417e-9ea1-bb99e038f3e0', 'volume_name': 'volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.794644 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930510e-402b-4c04-a6f0-ff37fb4cc5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.799852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930510e-402b-4c04-a6f0-ff37fb4cc5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.807615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba617565-c17c-4f4a-abe2-071ef33ca561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.808818 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Volume 79f93db4-df1f-417e-9ea1-bb99e038f3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0', 'volume_size': 1} Jun 18 22:29:31.809299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] creating volume 'volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:29:31.810114 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:31.912064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:31.912573 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:31.917391 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba617565-c17c-4f4a-abe2-071ef33ca561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.935258 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdd7bb5-4523-4220-8d2b-1fee722c0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:31.953991 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Volume volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0 (79f93db4-df1f-417e-9ea1-bb99e038f3e0): created successfully Jun 18 22:29:31.960755 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdd7bb5-4523-4220-8d2b-1fee722c0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:31.971571 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Flow 'volume_create_manager' (6234e7e5-a6f9-48da-b3c9-64d18bc88116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:31.993723 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1bd2d27a-33d3-4f75-ba62-fa7d2c2f2ce1 tempest-VolumesMetadataTest-1955217753 None] Created volume successfully. Jun 18 22:29:32.011415 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=56,cinder:INSERT=6,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:33.673313 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Lock "b'cinder-79f93db4-df1f-417e-9ea1-bb99e038f3e0-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:33.817863 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:33.912368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:33.912718 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Volume volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:33.925565 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] deleting rbd volume volume-79f93db4-df1f-417e-9ea1-bb99e038f3e0 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:34.346917 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Created reservations ['f75392fc-3fc9-4a77-82b4-e3c99a3679d6', '1077824b-1acd-4366-9853-33f5b18100dc', '1f1cd00d-992f-408e-9da4-fbc83a66ecfa', 'b73a1a0e-fd4e-4e96-8a0e-5a008ef06adc'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:34.448100 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:34.523422 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:34.596547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:34.605259 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Deleted volume successfully. Jun 18 22:29:34.624847 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-afbc7071-742f-4e21-b8ab-639870d59bee tempest-VolumesMetadataTest-1955217753 None] Lock "b'cinder-79f93db4-df1f-417e-9ea1-bb99e038f3e0-delete_volume'" released by "delete_volume" :: held 0.952s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:39.674483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:39.706910 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (91358fca-b013-4d40-a664-79a26b248a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:39.719017 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ca0d37-d711-4c3e-a08e-fc1304a821be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:39.770093 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ca0d37-d711-4c3e-a08e-fc1304a821be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-163233102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df50a51956d247dcb49a5ca1afed6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:40Z,use_quota=True,user_id='8a70ee3d2307456c8534b279c1f11f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:39.778862 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8591389-ce7f-4afa-a355-9c81f7e86356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:39.783886 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8591389-ce7f-4afa-a355-9c81f7e86356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:39.791567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a8407-e928-4ab5-ba79-ad6fd703fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:39.974147 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2a8407-e928-4ab5-ba79-ad6fd703fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'volume_name': 'volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:39.994112 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b967bf-501c-4b7b-ab44-d42459ac6548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:40.001296 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b967bf-501c-4b7b-ab44-d42459ac6548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:40.018535 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22472879-ed28-4b3b-9fbd-6234cbc7616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:40.024525 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Volume dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:29:40.025550 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Cloning dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:29:40.051437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:40.074423 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 29, 40, 60374)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:29:40.075177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:29:40.075861 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:29:40.081496 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:40.083751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:29:40.098857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 29, 40, 92354)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:29:40.102265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:29:40.103454 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:29:40.146797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:40.274500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] creating snapshot='volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:29:40.527032 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f.clone_snap' to 'volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:29:40.703563 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:40.705429 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:40.713161 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:40.733798 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:29:40.734437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Marking volume dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:29:40.753604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:29:40.754111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Creating volume glance metadata for volume dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:29:40.845239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22472879-ed28-4b3b-9fbd-6234cbc7616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:40.852144 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe582f6b-5055-43d8-9bfc-dd00dc59a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:40.868665 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Volume volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f (dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f): created successfully Jun 18 22:29:40.874269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe582f6b-5055-43d8-9bfc-dd00dc59a580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:40.881519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (91358fca-b013-4d40-a664-79a26b248a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:40.898640 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0ef5333-0fa2-48bc-9a29-b3b62bf61c93 tempest-VolumesCloneTest-583190178 None] Created volume successfully. Jun 18 22:29:42.705182 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:42.755018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (1e19c3cc-ff12-4c68-b667-773feae1ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:42.775234 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187f1ac5-65fd-4318-841c-fd40a184fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:42.829438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187f1ac5-65fd-4318-841c-fd40a184fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1338629884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e70d173a-e6a4-45e1-bcf8-409507c4af59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df50a51956d247dcb49a5ca1afed6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:43Z,use_quota=True,user_id='8a70ee3d2307456c8534b279c1f11f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:42.844488 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f467a70c-08fd-4453-9aff-e73d8e1a0c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:42.849995 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f467a70c-08fd-4453-9aff-e73d8e1a0c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:42.868281 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064cf44-a0cb-41c9-973c-124a49283901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:42.911559 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064cf44-a0cb-41c9-973c-124a49283901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e70d173a-e6a4-45e1-bcf8-409507c4af59', 'volume_name': 'volume-e70d173a-e6a4-45e1-bcf8-409507c4af59', 'volume_size': 1, 'source_volid': 'dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:42.927258 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fbb4e3-33e5-4c12-b44c-fefd0ab3a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:42.931602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fbb4e3-33e5-4c12-b44c-fefd0ab3a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:42.937112 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6c3a94-2ab0-4fd6-930c-4153bdb392ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:42.938225 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Volume e70d173a-e6a4-45e1-bcf8-409507c4af59: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e70d173a-e6a4-45e1-bcf8-409507c4af59', 'volume_size': 1, 'source_volid': 'dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'source_volstatus': 'available'} Jun 18 22:29:42.972068 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:43.090144 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] creating snapshot='volume-e70d173a-e6a4-45e1-bcf8-409507c4af59.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:29:43.612356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] cloning 'volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f@volume-e70d173a-e6a4-45e1-bcf8-409507c4af59.clone_snap' to 'volume-e70d173a-e6a4-45e1-bcf8-409507c4af59' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:29:43.923556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:43.926474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:43.927020 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:43.975064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:29:43.976078 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Marking volume e70d173a-e6a4-45e1-bcf8-409507c4af59 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:29:43.991604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Copying metadata from source volume dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f to e70d173a-e6a4-45e1-bcf8-409507c4af59. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}} Jun 18 22:29:44.134438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6c3a94-2ab0-4fd6-930c-4153bdb392ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70d173a-e6a4-45e1-bcf8-409507c4af59', 'volume_size': 1, 'source_volid': 'dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:44.147418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeeb222-a84f-4633-a8af-3c9aa6cdb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:44.175036 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Volume volume-e70d173a-e6a4-45e1-bcf8-409507c4af59 (e70d173a-e6a4-45e1-bcf8-409507c4af59): created successfully Jun 18 22:29:44.180915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeeb222-a84f-4633-a8af-3c9aa6cdb78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:44.199485 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (1e19c3cc-ff12-4c68-b667-773feae1ab72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:44.229600 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9472c266-1b41-4775-a304-7be20912f861 tempest-VolumesCloneTest-583190178 None] Created volume successfully. Jun 18 22:29:45.691319 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:45.726411 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (c43ed367-9c3d-4f29-a4d5-36686062d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:45.734705 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a419e5f7-5265-4579-8fb6-70d4fa5053f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.755825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a419e5f7-5265-4579-8fb6-70d4fa5053f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1309735772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4c85c38-c30d-4431-82ea-97363b8dc59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df50a51956d247dcb49a5ca1afed6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:46Z,use_quota=True,user_id='8a70ee3d2307456c8534b279c1f11f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.764892 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a95d4-5e79-421a-b8db-3a966e3f970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.769346 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a95d4-5e79-421a-b8db-3a966e3f970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.775769 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947fd788-7dd6-48ef-9bf7-f9792a2c9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.780648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947fd788-7dd6-48ef-9bf7-f9792a2c9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c85c38-c30d-4431-82ea-97363b8dc59b', 'volume_name': 'volume-b4c85c38-c30d-4431-82ea-97363b8dc59b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.787357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1cd712-eb68-45d3-8f20-dcb607af2d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.791509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1cd712-eb68-45d3-8f20-dcb607af2d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.796757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4499c05-a8c3-4898-9ba2-fab9ecf74ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.798051 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Volume b4c85c38-c30d-4431-82ea-97363b8dc59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c85c38-c30d-4431-82ea-97363b8dc59b', 'volume_size': 1} Jun 18 22:29:45.798599 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] creating volume 'volume-b4c85c38-c30d-4431-82ea-97363b8dc59b' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:29:45.799553 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:45.928739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:45.929717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:45.933500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4499c05-a8c3-4898-9ba2-fab9ecf74ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c85c38-c30d-4431-82ea-97363b8dc59b', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.938480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a1226-6fba-4022-8448-ea19330ae5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:45.964974 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Volume volume-b4c85c38-c30d-4431-82ea-97363b8dc59b (b4c85c38-c30d-4431-82ea-97363b8dc59b): created successfully Jun 18 22:29:45.969235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a1226-6fba-4022-8448-ea19330ae5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:45.980381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (c43ed367-9c3d-4f29-a4d5-36686062d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:46.001757 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f86df13f-47a6-4a41-bac5-57b043ba7d2a tempest-VolumesCloneTest-583190178 None] Created volume successfully. Jun 18 22:29:47.360228 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:29:47.361089 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:47.438086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:47.544902 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:47.551182 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:29:47.633506 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (0d40b0c7-76b5-4ba0-b384-48728f53e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:47.661343 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f69b09-bff0-45cb-8d4b-551c49800f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:47.699400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f69b09-bff0-45cb-8d4b-551c49800f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1968926460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9fc20b3-dad4-452b-ac76-4bbf41877b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df50a51956d247dcb49a5ca1afed6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:29:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b4c85c38-c30d-4431-82ea-97363b8dc59b,status='creating',terminated_at=None,updated_at=2022-06-18T22:29:47Z,use_quota=True,user_id='8a70ee3d2307456c8534b279c1f11f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:47.715815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b22f8f7-31b1-4dc6-870c-ebd932e4e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:47.720292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b22f8f7-31b1-4dc6-870c-ebd932e4e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:47.767360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0afd1c-4614-43b4-a8cd-63bad38859e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:47.792099 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0afd1c-4614-43b4-a8cd-63bad38859e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e9fc20b3-dad4-452b-ac76-4bbf41877b3a', 'volume_name': 'volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a', 'volume_size': 2, 'source_volid': 'b4c85c38-c30d-4431-82ea-97363b8dc59b', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:47.803128 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4bf84a-900a-46fb-825b-db4f0fbd716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:47.825018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4bf84a-900a-46fb-825b-db4f0fbd716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:47.829912 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9107be1-3bda-40cd-a52f-67a60da7797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:47.830991 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Volume e9fc20b3-dad4-452b-ac76-4bbf41877b3a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a', 'volume_size': 2, 'source_volid': 'b4c85c38-c30d-4431-82ea-97363b8dc59b', 'source_volstatus': 'available'} Jun 18 22:29:47.866547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:47.965739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] creating snapshot='volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:29:48.715772 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] cloning 'volume-b4c85c38-c30d-4431-82ea-97363b8dc59b@volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a.clone_snap' to 'volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:29:48.899842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Volume volume-b4c85c38-c30d-4431-82ea-97363b8dc59b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:48.900962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:29:48.901381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:29:48.931221 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] resize volume 'volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a' from 1 to 2 {{(pid=123873) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}} Jun 18 22:29:48.931865 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:49.117753 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:29:49.123501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9107be1-3bda-40cd-a52f-67a60da7797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a', 'volume_size': 2, 'source_volid': 'b4c85c38-c30d-4431-82ea-97363b8dc59b', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:49.129361 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a9619-7f46-42b0-b13d-2ebb571ce801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:29:49.150105 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Volume volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a (e9fc20b3-dad4-452b-ac76-4bbf41877b3a): created successfully Jun 18 22:29:49.155589 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05a9619-7f46-42b0-b13d-2ebb571ce801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:29:49.179508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Flow 'volume_create_manager' (0d40b0c7-76b5-4ba0-b384-48728f53e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:29:49.216133 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e9be2450-949e-4a6d-bfdb-63c9254983f3 tempest-VolumesCloneTest-583190178 None] Created volume successfully. Jun 18 22:29:49.612914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-e9fc20b3-dad4-452b-ac76-4bbf41877b3a-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:49.726322 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:49.838893 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:49.850401 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] deleting rbd volume volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:50.189252 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:29:50.216852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Volume volume-b4c85c38-c30d-4431-82ea-97363b8dc59b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:50.218557 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] deleting parent snapshot volume-e9fc20b3-dad4-452b-ac76-4bbf41877b3a.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:29:50.819101 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=53,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=20 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:50.908543 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Created reservations ['67da103d-26fb-446d-957c-8883e8fcccc8', 'ac101927-8117-4c1b-9c75-c16380857150', '38f88074-7a03-4151-b550-25ccd46f086b', '685c85b8-1186-44b8-a0a5-94f34a433d7c'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:51.019356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:51.089410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:51.142662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:51.146976 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Deleted volume successfully. Jun 18 22:29:51.170953 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-b89c8ce4-f9e6-4f78-a00c-1a16a667a6e7 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-e9fc20b3-dad4-452b-ac76-4bbf41877b3a-delete_volume'" released by "delete_volume" :: held 1.558s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:52.000866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-b4c85c38-c30d-4431-82ea-97363b8dc59b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:52.082859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:52.188407 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:52.188789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Volume volume-b4c85c38-c30d-4431-82ea-97363b8dc59b is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:29:52.199487 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] deleting rbd volume volume-b4c85c38-c30d-4431-82ea-97363b8dc59b {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:52.560806 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=69,cinder:UPDATE=18,cinder:INSERT=11,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:52.646982 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Created reservations ['9ee7d3ae-c1b2-4221-af6b-be664f680650', 'bf123f7d-5609-4021-b7a3-802e678c84b6', '531f1bbd-40e8-4b97-a943-5d7294d8af67', 'b848dc5b-a29e-4b54-82f6-6389c8011f28'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:52.768877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:52.837350 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:52.898792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:52.910700 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Deleted volume successfully. Jun 18 22:29:52.933593 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8fc4cdf5-4cf3-4d07-8373-4b42d420b487 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-b4c85c38-c30d-4431-82ea-97363b8dc59b-delete_volume'" released by "delete_volume" :: held 0.932s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:53.333601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-e70d173a-e6a4-45e1-bcf8-409507c4af59-delete_volume'" acquired by "delete_volume" :: waited 0.061s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:53.482153 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:53.604061 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:53.611354 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] deleting rbd volume volume-e70d173a-e6a4-45e1-bcf8-409507c4af59 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:54.071695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:29:54.150345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] deleting parent snapshot volume-e70d173a-e6a4-45e1-bcf8-409507c4af59.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:29:54.925514 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] Created reservations ['fa54d2aa-e0bc-44d2-a335-dfe741047d3c', '634ef83f-8380-4b37-9130-3ddfff2f8166', '86b32d7d-1689-4f21-9f54-ecfd68480288', 'c2a2abfc-f971-4c72-ac38-02a747ec3b7d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:55.032587 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:55.183531 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:55.255322 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:55.259749 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] Deleted volume successfully. Jun 18 22:29:55.278813 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-ebee8679-598a-4dd5-bf69-5f24a28bc950 tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-e70d173a-e6a4-45e1-bcf8-409507c4af59-delete_volume'" released by "delete_volume" :: held 1.945s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:29:55.757318 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:29:55.840534 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:55.984456 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:29:55.994903 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] deleting rbd volume volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:29:56.353911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:29:56.407979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] deleting parent snapshot volume-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:29:57.610341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] Created reservations ['5b36c38e-6b4b-42c1-99b7-8a31853f1b22', 'b453f7d9-277b-496a-9452-377259a15551', '20c1ff0a-10db-48c2-ae56-b041b17c2e76', 'bc5e5218-d74d-4699-95dc-c6c556138138'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:29:57.721253 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:57.799690 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:29:57.870747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:29:57.874725 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] Deleted volume successfully. Jun 18 22:29:57.894752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-46827278-432c-4eab-930c-5b3fe0caa3ca tempest-VolumesCloneTest-583190178 None] Lock "b'cinder-dbb0c4bb-eaa6-4504-93c5-b94b00d2fc8f-delete_volume'" released by "delete_volume" :: held 2.137s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:02.965123 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=48,cinder:INSERT=7,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:02.997022 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:03.046810 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Flow 'volume_create_manager' (2f3dddab-a435-40de-8ed6-6e0218204612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:03.053773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c67649c-aaed-4626-a568-8917c4f327df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:03.072115 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c67649c-aaed-4626-a568-8917c4f327df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-707652990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c01c37ac-36e2-429c-86f5-19f34a8dba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec1edee2a79449ba938310fa3810695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:03Z,use_quota=True,user_id='8df56507fb7e4c6eb012fbea8bb5a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:03.077695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f90a62-e3cf-49f9-a4b0-e098b0fdc255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:03.082459 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f90a62-e3cf-49f9-a4b0-e098b0fdc255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:03.088632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7927ce-44b5-487f-ace8-cde279e9797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:03.212331 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7927ce-44b5-487f-ace8-cde279e9797d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c01c37ac-36e2-429c-86f5-19f34a8dba11', 'volume_name': 'volume-c01c37ac-36e2-429c-86f5-19f34a8dba11', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:03.217519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a76e3ea-6603-40a7-acfb-85d3ebea0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:03.231425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a76e3ea-6603-40a7-acfb-85d3ebea0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:03.239617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5172f9-b39e-4a29-8f5b-f03686f5703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:03.241564 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Volume c01c37ac-36e2-429c-86f5-19f34a8dba11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c01c37ac-36e2-429c-86f5-19f34a8dba11', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:30:03.242540 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Cloning c01c37ac-36e2-429c-86f5-19f34a8dba11 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:30:03.268923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:03.284878 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 3, 277305)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:03.285933 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:03.287285 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:30:03.293687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:03.295685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:30:03.303112 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 3, 300186)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:03.303917 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:03.304549 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:30:03.320410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:03.434190 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] creating snapshot='volume-c01c37ac-36e2-429c-86f5-19f34a8dba11.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:30:03.588502 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-c01c37ac-36e2-429c-86f5-19f34a8dba11.clone_snap' to 'volume-c01c37ac-36e2-429c-86f5-19f34a8dba11' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:30:03.840831 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:03.843183 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:03.843832 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:03.864215 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:30:03.865483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Marking volume c01c37ac-36e2-429c-86f5-19f34a8dba11 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:30:03.890152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to c01c37ac-36e2-429c-86f5-19f34a8dba11. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:30:03.890849 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Creating volume glance metadata for volume c01c37ac-36e2-429c-86f5-19f34a8dba11 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:30:04.049747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5172f9-b39e-4a29-8f5b-f03686f5703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01c37ac-36e2-429c-86f5-19f34a8dba11', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:04.054473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb160198-f6c5-4418-ae96-735f5b98811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:04.068919 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Volume volume-c01c37ac-36e2-429c-86f5-19f34a8dba11 (c01c37ac-36e2-429c-86f5-19f34a8dba11): created successfully Jun 18 22:30:04.074416 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb160198-f6c5-4418-ae96-735f5b98811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:04.098236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Flow 'volume_create_manager' (2f3dddab-a435-40de-8ed6-6e0218204612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:04.114025 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-310e8b56-6f36-4b13-a988-250e65b7588c tempest-VolumesExtendTest-1674800927 None] Created volume successfully. Jun 18 22:30:05.432986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7b2aa698-3598-41bf-85ce-eb60a772b815 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:05.655745 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7b2aa698-3598-41bf-85ce-eb60a772b815 tempest-VolumesExtendTest-1674800927 None] Extend volume from 1 GB to 2 GB. {{(pid=123873) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jun 18 22:30:05.728634 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7b2aa698-3598-41bf-85ce-eb60a772b815 tempest-VolumesExtendTest-1674800927 None] Extend volume completed successfully. Jun 18 22:30:07.515509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:07.544879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Flow 'volume_create_manager' (2e63de22-5fea-4f41-b95f-543ce441245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:07.571543 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1152f99-18db-4bc6-b51f-cf6a640138cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.591239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1152f99-18db-4bc6-b51f-cf6a640138cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-820652716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a3730a02-9b74-41d2-a9d2-d54403274beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec1edee2a79449ba938310fa3810695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:07Z,use_quota=True,user_id='8df56507fb7e4c6eb012fbea8bb5a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.596785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0a84be-21d6-434b-9a07-e91d53142dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.602204 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0a84be-21d6-434b-9a07-e91d53142dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.608439 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19632eee-a4d8-4e68-96dc-ad3964a01d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.613617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19632eee-a4d8-4e68-96dc-ad3964a01d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3730a02-9b74-41d2-a9d2-d54403274beb', 'volume_name': 'volume-a3730a02-9b74-41d2-a9d2-d54403274beb', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.620336 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3dacc6-a886-4603-8343-56ea47c0d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.638468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3dacc6-a886-4603-8343-56ea47c0d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.653074 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a761b38b-1b8f-4344-8bf4-747e47387a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.656901 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Volume a3730a02-9b74-41d2-a9d2-d54403274beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3730a02-9b74-41d2-a9d2-d54403274beb', 'volume_size': 1} Jun 18 22:30:07.657443 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] creating volume 'volume-a3730a02-9b74-41d2-a9d2-d54403274beb' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:07.662493 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:07.844070 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:07.844457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:07.855596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a761b38b-1b8f-4344-8bf4-747e47387a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3730a02-9b74-41d2-a9d2-d54403274beb', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.863181 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e7b18d-5832-4a57-9ded-17c656ef4970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:07.896298 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Volume volume-a3730a02-9b74-41d2-a9d2-d54403274beb (a3730a02-9b74-41d2-a9d2-d54403274beb): created successfully Jun 18 22:30:07.900608 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e7b18d-5832-4a57-9ded-17c656ef4970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:07.909071 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Flow 'volume_create_manager' (2e63de22-5fea-4f41-b95f-543ce441245c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:07.925733 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9a3ef8a8-f22c-4a66-a76c-7d762e8a4985 tempest-VolumesExtendTest-1674800927 None] Created volume successfully. Jun 18 22:30:09.129409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-043545ca-2c29-4394-8f8e-57d3884de0cf tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:09.808551 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-043545ca-2c29-4394-8f8e-57d3884de0cf tempest-VolumesExtendTest-1674800927 None] Create snapshot completed successfully Jun 18 22:30:10.500378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fb580c4e-aa6e-4957-9d8c-7b96ae791535 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:10.675325 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fb580c4e-aa6e-4957-9d8c-7b96ae791535 tempest-VolumesExtendTest-1674800927 None] Extend volume from 1 GB to 2 GB. {{(pid=123873) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jun 18 22:30:10.687358 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=56,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:10.759145 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fb580c4e-aa6e-4957-9d8c-7b96ae791535 tempest-VolumesExtendTest-1674800927 None] Extend volume completed successfully. Jun 18 22:30:12.049475 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10c517ae-21a7-4c64-8481-4795241b1949 tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-152c62f1-7238-4f12-960a-08839f4ffdc7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:12.055922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10c517ae-21a7-4c64-8481-4795241b1949 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:12.972961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-10c517ae-21a7-4c64-8481-4795241b1949 tempest-VolumesExtendTest-1674800927 None] Created reservations ['f1ae2b1f-87e7-483e-86d7-f86f7fd13df7', 'b2466c47-4f88-4d2a-a179-a3c5e733dd35', '48024788-411b-42d4-bf28-2d59f3fa943b', '936f54e7-b657-4517-ad81-d7070b098cd0'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:13.094293 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-10c517ae-21a7-4c64-8481-4795241b1949 tempest-VolumesExtendTest-1674800927 None] Delete snapshot completed successfully. Jun 18 22:30:13.110906 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10c517ae-21a7-4c64-8481-4795241b1949 tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-152c62f1-7238-4f12-960a-08839f4ffdc7-delete_snapshot'" released by "delete_snapshot" :: held 1.061s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:13.529401 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-a3730a02-9b74-41d2-a9d2-d54403274beb-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:13.692394 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:13.822266 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:13.823157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Volume volume-a3730a02-9b74-41d2-a9d2-d54403274beb is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:13.836156 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] deleting rbd volume volume-a3730a02-9b74-41d2-a9d2-d54403274beb {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:14.354645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Created reservations ['d5ec4377-b522-4b7c-aec8-02455607e208', 'd3622413-4dea-4da1-ad4f-3791f573ffae', 'f91323de-d3e5-4df8-be47-28b49b402faf', '06437e2b-17c9-4f9e-9dca-74e223a17dd5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:14.582999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:14.632389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:14.693152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:14.697845 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Deleted volume successfully. Jun 18 22:30:14.726853 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8988d3c0-3581-4d6b-b5a9-ce13bb62237c tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-a3730a02-9b74-41d2-a9d2-d54403274beb-delete_volume'" released by "delete_volume" :: held 1.197s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:14.859408 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-c01c37ac-36e2-429c-86f5-19f34a8dba11-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:14.981054 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:15.114087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:15.124213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] deleting rbd volume volume-c01c37ac-36e2-429c-86f5-19f34a8dba11 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:15.440092 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:30:15.512946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] deleting parent snapshot volume-c01c37ac-36e2-429c-86f5-19f34a8dba11.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:30:16.533996 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=10 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:16.596327 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] Created reservations ['8a391f4c-27d0-4982-a001-44938d10fba6', '7b88717a-9de7-422a-a02a-ec65a86168b5', '822f5f02-7afa-4c80-9714-81e9002cd7fa', '9e16635d-8c93-497e-8893-62750726d50e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:16.704551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:16.871019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:16.928969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:16.933096 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] Deleted volume successfully. Jun 18 22:30:16.957787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-90d777ea-2aad-45d1-8d65-606518306ee7 tempest-VolumesExtendTest-1674800927 None] Lock "b'cinder-c01c37ac-36e2-429c-86f5-19f34a8dba11-delete_volume'" released by "delete_volume" :: held 2.100s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:21.157588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:21.231227 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (62f1260d-f26a-4ba7-8570-8c319438aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:21.250311 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a882929c-33b9-4146-8d99-374cddb508a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.308308 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a882929c-33b9-4146-8d99-374cddb508a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1528733165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf25b67c-5d06-4d15-8da8-ef1311129704,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:21Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.316030 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3873f138-3641-45af-b392-707a64c9cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.331706 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3873f138-3641-45af-b392-707a64c9cd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.344034 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dca36e6-8b9f-47a5-8494-941a2f58f700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.349223 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dca36e6-8b9f-47a5-8494-941a2f58f700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf25b67c-5d06-4d15-8da8-ef1311129704', 'volume_name': 'volume-cf25b67c-5d06-4d15-8da8-ef1311129704', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.355736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9547e064-59e8-4547-b383-646ad47cbaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.359954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9547e064-59e8-4547-b383-646ad47cbaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.365616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d422d85-91aa-41df-a234-e109aa1342c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.366987 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Volume cf25b67c-5d06-4d15-8da8-ef1311129704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf25b67c-5d06-4d15-8da8-ef1311129704', 'volume_size': 1} Jun 18 22:30:21.367593 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] creating volume 'volume-cf25b67c-5d06-4d15-8da8-ef1311129704' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:21.369382 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:21.476222 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:21.476979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:21.481970 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d422d85-91aa-41df-a234-e109aa1342c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf25b67c-5d06-4d15-8da8-ef1311129704', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.492211 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8727693-3e9a-4e8c-b556-b439f25f6efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:21.515453 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Volume volume-cf25b67c-5d06-4d15-8da8-ef1311129704 (cf25b67c-5d06-4d15-8da8-ef1311129704): created successfully Jun 18 22:30:21.522619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8727693-3e9a-4e8c-b556-b439f25f6efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:21.539814 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (62f1260d-f26a-4ba7-8570-8c319438aa23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:21.560835 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-befd2d11-d2c1-4113-872a-619976d0ab07 tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:23.475711 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:23.502538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (2a0f3633-2eec-4ac7-b7e4-b3abf988d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:23.512047 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4919cf42-db3a-4bcb-ae85-7c05736236b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.530839 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4919cf42-db3a-4bcb-ae85-7c05736236b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1400834827',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a30b401-44e5-481c-9214-83254463625e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:23Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.537552 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17ffe98-f0b3-40d3-9ef2-fe3bc25f4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.543359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17ffe98-f0b3-40d3-9ef2-fe3bc25f4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.550869 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e8fd6-b04b-495b-9018-61094313d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.562677 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e8fd6-b04b-495b-9018-61094313d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a30b401-44e5-481c-9214-83254463625e', 'volume_name': 'volume-6a30b401-44e5-481c-9214-83254463625e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.570274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52516c01-7f4c-4314-8cd9-0986b216cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.576480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52516c01-7f4c-4314-8cd9-0986b216cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.582390 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535e5a06-b8ce-4d3b-8f4a-4f5f914be3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.584023 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Volume 6a30b401-44e5-481c-9214-83254463625e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a30b401-44e5-481c-9214-83254463625e', 'volume_size': 1} Jun 18 22:30:23.585403 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] creating volume 'volume-6a30b401-44e5-481c-9214-83254463625e' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:23.586239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:23.792744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:23.793445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:23.798146 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535e5a06-b8ce-4d3b-8f4a-4f5f914be3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a30b401-44e5-481c-9214-83254463625e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.804371 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50fc8ae-eaef-4ee6-8271-d8280e98ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:23.834132 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Volume volume-6a30b401-44e5-481c-9214-83254463625e (6a30b401-44e5-481c-9214-83254463625e): created successfully Jun 18 22:30:23.837680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50fc8ae-eaef-4ee6-8271-d8280e98ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:23.858685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (2a0f3633-2eec-4ac7-b7e4-b3abf988d51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:23.893569 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c8cbacf1-99ae-4a80-8205-a9d143c6a194 tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:24.692278 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-6a30b401-44e5-481c-9214-83254463625e-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:24.808417 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:24.921048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:24.921398 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Volume volume-6a30b401-44e5-481c-9214-83254463625e is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:24.934574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-6a30b401-44e5-481c-9214-83254463625e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:25.404109 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Created reservations ['18780966-02a7-4aad-9ee5-17afdd1b248d', 'f41d2b75-fb67-4e9f-b9d5-d1315d7b2b39', 'f9a8fd9d-0927-4ab0-bb62-e6922bc32459', 'e042d29c-1c7b-4fae-8e77-dc02a704aaae'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:25.506115 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:INSERT=11,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:25.543650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:25.644636 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:25.699300 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:25.708383 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:25.738391 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8898d12c-b08f-4a79-8169-c19f3aa453a9 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-6a30b401-44e5-481c-9214-83254463625e-delete_volume'" released by "delete_volume" :: held 1.042s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:25.930011 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-cf25b67c-5d06-4d15-8da8-ef1311129704-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:26.034434 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:26.129785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:26.133929 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Volume volume-cf25b67c-5d06-4d15-8da8-ef1311129704 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:26.158885 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-cf25b67c-5d06-4d15-8da8-ef1311129704 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:26.574894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Created reservations ['979ac48e-34b9-4919-9825-e23f18b9d7ff', 'c3677325-4e3b-49fb-93ba-74a6ec96fe76', '31fbda6f-06cb-4137-9f7f-dd0886a56a0d', '5239659a-e14f-4d34-a726-c08c572e54b9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:26.716059 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:26.789458 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:26.868908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:26.873097 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:26.899150 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c6d2b194-ba95-430b-a2c6-b9061673f940 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-cf25b67c-5d06-4d15-8da8-ef1311129704-delete_volume'" released by "delete_volume" :: held 0.970s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:27.978450 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:28.088342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (4cfefcab-b3f9-492c-9fdb-ef0731144590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:28.129567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13130998-4003-4431-92c9-65910405a947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.168821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13130998-4003-4431-92c9-65910405a947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1902301444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd692f47-d055-43d3-8d2d-ca0f30fdf0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:28Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.175209 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a8dd2-fbe2-4531-aa8c-fc72e71fad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.180049 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a8dd2-fbe2-4531-aa8c-fc72e71fad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.186435 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eb2a21-4b0d-4072-b547-685d7cdfa6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.197721 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eb2a21-4b0d-4072-b547-685d7cdfa6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'volume_name': 'volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.203075 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fc0929-efff-4579-a181-5b2667851744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.207706 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fc0929-efff-4579-a181-5b2667851744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.213827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4537ed33-6847-4aab-8962-01ada29c55d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.214932 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Volume fd692f47-d055-43d3-8d2d-ca0f30fdf0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'volume_size': 1} Jun 18 22:30:28.215328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] creating volume 'volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:28.216112 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:28.371506 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:28.372052 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:28.376548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4537ed33-6847-4aab-8962-01ada29c55d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.390540 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbdd8a7-ff2f-4987-92c3-7373a53940b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:28.410650 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Volume volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7 (fd692f47-d055-43d3-8d2d-ca0f30fdf0e7): created successfully Jun 18 22:30:28.415714 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbdd8a7-ff2f-4987-92c3-7373a53940b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:28.427095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (4cfefcab-b3f9-492c-9fdb-ef0731144590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:28.455739 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ec9242ea-1fae-4034-8699-2d9c8f8bb10c tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:30.025394 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:30.099681 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (cd9cd12f-0c58-4d3f-963a-d2aa277082b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:30.108947 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a5dad-62c4-4d4b-a662-9cfa9095e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:30.155614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a5dad-62c4-4d4b-a662-9cfa9095e15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-828599167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee081613-f149-45d5-a3b2-47d4d5a310ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fd692f47-d055-43d3-8d2d-ca0f30fdf0e7,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:30Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:30.198048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c15840-5d0b-43b2-9084-9ccb0e2e93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:30.210287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c15840-5d0b-43b2-9084-9ccb0e2e93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:30.227609 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0c8559-fa39-4f97-a432-090fab12692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:30.271133 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0c8559-fa39-4f97-a432-090fab12692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ee081613-f149-45d5-a3b2-47d4d5a310ea', 'volume_name': 'volume-ee081613-f149-45d5-a3b2-47d4d5a310ea', 'volume_size': 1, 'source_volid': 'fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:30.284539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3286ca42-d3e7-4835-926a-1f5566ccfda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:30.296531 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3286ca42-d3e7-4835-926a-1f5566ccfda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:30.313292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac4425e-861d-4971-b0d7-ba2c363d298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:30.314988 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Volume ee081613-f149-45d5-a3b2-47d4d5a310ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ee081613-f149-45d5-a3b2-47d4d5a310ea', 'volume_size': 1, 'source_volid': 'fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'source_volstatus': 'available'} Jun 18 22:30:30.332412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:30.438247 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] creating snapshot='volume-ee081613-f149-45d5-a3b2-47d4d5a310ea.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:30:30.765783 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] cloning 'volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7@volume-ee081613-f149-45d5-a3b2-47d4d5a310ea.clone_snap' to 'volume-ee081613-f149-45d5-a3b2-47d4d5a310ea' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:30:30.947110 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Volume volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:30.949778 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:30.950156 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:30.991372 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:30:30.996955 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac4425e-861d-4971-b0d7-ba2c363d298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee081613-f149-45d5-a3b2-47d4d5a310ea', 'volume_size': 1, 'source_volid': 'fd692f47-d055-43d3-8d2d-ca0f30fdf0e7', 'source_volstatus': 'available'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:31.003390 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88798b18-d16c-458b-88f6-2f676cc32884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:31.057398 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Volume volume-ee081613-f149-45d5-a3b2-47d4d5a310ea (ee081613-f149-45d5-a3b2-47d4d5a310ea): created successfully Jun 18 22:30:31.063578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88798b18-d16c-458b-88f6-2f676cc32884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:31.075056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (cd9cd12f-0c58-4d3f-963a-d2aa277082b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:31.119699 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-41c7f119-a227-476f-b2b0-bfca3ab9c477 tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:33.306473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:33.386378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (e73130a1-638a-4156-abb2-8cbfa099ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:33.417695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5360b877-df36-4755-8a4a-174ffbb6d582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.454089 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5360b877-df36-4755-8a4a-174ffbb6d582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-569670072',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1e32c1c3-4765-4ea6-bae4-25a3fe69a968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:33Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.463246 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad38d25f-87ed-4fc4-afe0-58c2f68f3063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.468510 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad38d25f-87ed-4fc4-afe0-58c2f68f3063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.476791 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f945242-3ecb-400b-b1f8-acb23e750220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.484964 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f945242-3ecb-400b-b1f8-acb23e750220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e32c1c3-4765-4ea6-bae4-25a3fe69a968', 'volume_name': 'volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.491520 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2f4c47-5067-4dc7-b4fa-0baf8d15afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.496056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2f4c47-5067-4dc7-b4fa-0baf8d15afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.502824 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7636948-35fb-4c1d-95f5-f536ae64d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.504162 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Volume 1e32c1c3-4765-4ea6-bae4-25a3fe69a968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968', 'volume_size': 1} Jun 18 22:30:33.504807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] creating volume 'volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:33.506352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:33.611997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:33.612592 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:33.619405 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7636948-35fb-4c1d-95f5-f536ae64d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.628957 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02ab5d8-7a82-4d6a-b86e-d058fb765161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:33.648582 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Volume volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968 (1e32c1c3-4765-4ea6-bae4-25a3fe69a968): created successfully Jun 18 22:30:33.654087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02ab5d8-7a82-4d6a-b86e-d058fb765161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:33.663955 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (e73130a1-638a-4156-abb2-8cbfa099ed65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:33.690545 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-69be6da6-d207-4a67-9310-cf1e1850bb6d tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:34.576453 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-1e32c1c3-4765-4ea6-bae4-25a3fe69a968-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:34.689754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:34.779900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:34.780673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Volume volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:34.795106 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-1e32c1c3-4765-4ea6-bae4-25a3fe69a968 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:35.338282 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Created reservations ['5964b256-ea4d-412c-b347-735367022700', 'b91c32ac-08fe-47bd-a581-989acd0d16c7', 'd2985933-0f88-4353-9f90-c92b70d7263e', 'ec036076-c391-46a3-a946-712eaff46b20'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:35.419355 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=4,cinder:UPDATE=31,cinder:SELECT=60,cinder:DELETE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:35.488303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:35.592658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:35.705390 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:35.711070 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:35.743651 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4b2909fc-f18f-409d-86a3-73488159ab76 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-1e32c1c3-4765-4ea6-bae4-25a3fe69a968-delete_volume'" released by "delete_volume" :: held 1.167s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:36.016200 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-ee081613-f149-45d5-a3b2-47d4d5a310ea-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:36.147984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:36.330470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:36.347519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-ee081613-f149-45d5-a3b2-47d4d5a310ea {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:36.736679 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:30:36.779397 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Volume volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:36.779849 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] deleting parent snapshot volume-ee081613-f149-45d5-a3b2-47d4d5a310ea.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:30:38.064342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:38.094860 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (f6a772f4-26e5-48e4-b095-25b9fc7d7aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:38.112497 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e0d7de-d0f5-442a-8d0f-17a2d46210c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:38.151577 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e0d7de-d0f5-442a-8d0f-17a2d46210c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-936930698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=58b87a75-cb09-457c-9830-0d503bfb59bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:38Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:38.168215 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523b18-56f4-4f45-9495-8dcaf98d5cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:38.182485 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523b18-56f4-4f45-9495-8dcaf98d5cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:38.203162 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cce6d57-e762-4a26-b4a0-23a6185d76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:38.309911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Created reservations ['89288b1b-bb6d-470c-951c-3e62acd249b8', 'dbbbc34f-20c4-4ab4-a68a-3d5687eb8426', '692b1801-abd0-4fa5-8f7a-3d5460c11c89', 'd38efa26-9e4e-42bc-a8d2-928539a3e888'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:38.453424 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cce6d57-e762-4a26-b4a0-23a6185d76ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58b87a75-cb09-457c-9830-0d503bfb59bd', 'volume_name': 'volume-58b87a75-cb09-457c-9830-0d503bfb59bd', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:38.475588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27cd758-af5a-4846-b717-7f666f0aa3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:38.505343 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27cd758-af5a-4846-b717-7f666f0aa3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:38.523895 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9438d9-2912-4697-aaca-9839a7836613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:38.526414 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Volume 58b87a75-cb09-457c-9830-0d503bfb59bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58b87a75-cb09-457c-9830-0d503bfb59bd', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:30:38.526990 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Cloning 58b87a75-cb09-457c-9830-0d503bfb59bd from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:30:38.609593 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:38.626406 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:38.779965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:38.902717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:38.906231 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.377s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:38.925803 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:38.951146 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 38, 921948)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:38.957974 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:38.958623 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:30:38.979500 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-caeabd2c-847a-4f5e-bef3-0f6dd8f6aa6f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-ee081613-f149-45d5-a3b2-47d4d5a310ea-delete_volume'" released by "delete_volume" :: held 2.971s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:38.984741 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.079s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:38.985836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:30:39.001659 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 38, 994212)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:39.002079 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:39.002473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:30:39.042716 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:39.171137 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] creating snapshot='volume-58b87a75-cb09-457c-9830-0d503bfb59bd.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:30:40.004914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-58b87a75-cb09-457c-9830-0d503bfb59bd.clone_snap' to 'volume-58b87a75-cb09-457c-9830-0d503bfb59bd' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:30:40.097635 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:40.224076 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (b1e88fb8-14fe-497f-b6c4-287144c57d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:40.252764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7671af5-0cec-4392-bd1c-f02041446a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:40.345667 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:40.347240 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:40.347792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:40.383227 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:30:40.384152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Marking volume 58b87a75-cb09-457c-9830-0d503bfb59bd as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:30:40.410128 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 58b87a75-cb09-457c-9830-0d503bfb59bd. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:30:40.412066 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Creating volume glance metadata for volume 58b87a75-cb09-457c-9830-0d503bfb59bd backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:30:40.477087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7671af5-0cec-4392-bd1c-f02041446a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1954164676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=de2c4dc9-745e-4a90-a045-998ffa1b5e6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:40Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.491283 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15d0a37-0006-4ed2-afe6-7a5744af933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:40.499023 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15d0a37-0006-4ed2-afe6-7a5744af933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.521468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fb6a4e-567a-4b40-92f4-4fc276e4457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:40.686384 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9438d9-2912-4697-aaca-9839a7836613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b87a75-cb09-457c-9830-0d503bfb59bd', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.712412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a53adf-077a-40a7-a533-2d7c7147cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:40.793820 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Volume volume-58b87a75-cb09-457c-9830-0d503bfb59bd (58b87a75-cb09-457c-9830-0d503bfb59bd): created successfully Jun 18 22:30:40.809868 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a53adf-077a-40a7-a533-2d7c7147cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.875922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (f6a772f4-26e5-48e4-b095-25b9fc7d7aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:40.925512 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e8446cd8-e8b3-46ff-a3c4-c8d1b17a0951 tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:30:40.957091 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fb6a4e-567a-4b40-92f4-4fc276e4457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de2c4dc9-745e-4a90-a045-998ffa1b5e6d', 'volume_name': 'volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.976765 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d79645-6c89-429f-8b92-359d0c5e80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:40.982043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d79645-6c89-429f-8b92-359d0c5e80a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:40.998723 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e546617-bc2e-42bd-926b-bf306bb4b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:41.002858 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Volume de2c4dc9-745e-4a90-a045-998ffa1b5e6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:30:41.004362 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Cloning de2c4dc9-745e-4a90-a045-998ffa1b5e6d from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:30:41.048173 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.042s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:41.078381 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 41, 63791)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:41.079367 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:41.080396 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:30:41.094678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:41.097654 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:30:41.114685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 30, 41, 108325)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:30:41.115394 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:30:41.115951 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:30:41.146659 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:41.318574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] creating snapshot='volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:30:42.089432 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d.clone_snap' to 'volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:30:42.177607 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bce45fde-af4c-46b9-a279-ca236ec7de73 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:42.492036 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:42.493167 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:42.493638 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:42.536710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:30:42.538024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Marking volume de2c4dc9-745e-4a90-a045-998ffa1b5e6d as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:30:42.552887 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to de2c4dc9-745e-4a90-a045-998ffa1b5e6d. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:30:42.553892 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Creating volume glance metadata for volume de2c4dc9-745e-4a90-a045-998ffa1b5e6d backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:30:42.686825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e546617-bc2e-42bd-926b-bf306bb4b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:42.698522 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18710e07-f101-46d1-95d9-710464390c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:42.718754 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Volume volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d (de2c4dc9-745e-4a90-a045-998ffa1b5e6d): created successfully Jun 18 22:30:42.723404 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18710e07-f101-46d1-95d9-710464390c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:42.738153 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (b1e88fb8-14fe-497f-b6c4-287144c57d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:42.756662 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a02cab24-3566-46d9-bcf1-93846729c02f tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:43.200838 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=17,cinder:SELECT=51,cinder:INSERT=30,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:43.226276 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bce45fde-af4c-46b9-a279-ca236ec7de73 tempest-TestVolumeBootPattern-2084543740 None] Create snapshot completed successfully Jun 18 22:30:44.410050 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:44.440713 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (a115589b-2262-45f8-acd8-1dbf59747422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:44.448551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a4de47-ecf2-4829-a8e9-45e214cc6edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.469613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a4de47-ecf2-4829-a8e9-45e214cc6edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1357983590',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ab28413-3104-4237-93b5-31e02826c6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e959db1a264037960eb2a3d7ef1582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:44Z,use_quota=True,user_id='28f81713c9b0454eb5dd6d3784a73925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.476223 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0183b767-c9fd-47fa-bf38-516b6a52ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.480494 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0183b767-c9fd-47fa-bf38-516b6a52ae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.485538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b17a3f2-ee8c-4a55-b78c-4b0f796aa31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.489913 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b17a3f2-ee8c-4a55-b78c-4b0f796aa31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab28413-3104-4237-93b5-31e02826c6bd', 'volume_name': 'volume-1ab28413-3104-4237-93b5-31e02826c6bd', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.494687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9b8e1a-4836-4908-9a1b-dc4d4acfc1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.498537 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9b8e1a-4836-4908-9a1b-dc4d4acfc1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.503091 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006214c6-47f6-4fce-adea-edf77fa90d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.504487 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Volume 1ab28413-3104-4237-93b5-31e02826c6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab28413-3104-4237-93b5-31e02826c6bd', 'volume_size': 1} Jun 18 22:30:44.504883 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] creating volume 'volume-1ab28413-3104-4237-93b5-31e02826c6bd' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:44.505684 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:44.574735 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:44.576551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:44.582374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006214c6-47f6-4fce-adea-edf77fa90d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab28413-3104-4237-93b5-31e02826c6bd', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.588287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1eb658-90f5-4fdb-aafa-ccf02de210ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:44.600822 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Volume volume-1ab28413-3104-4237-93b5-31e02826c6bd (1ab28413-3104-4237-93b5-31e02826c6bd): created successfully Jun 18 22:30:44.608724 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1eb658-90f5-4fdb-aafa-ccf02de210ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:44.616174 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Flow 'volume_create_manager' (a115589b-2262-45f8-acd8-1dbf59747422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:44.626673 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-047129d5-e2a3-42d5-9c1c-286d401fcdb3 tempest-VolumesGetTest-1169044513 None] Created volume successfully. Jun 18 22:30:45.551537 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-1ab28413-3104-4237-93b5-31e02826c6bd-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:45.620723 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:45.716034 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:45.716604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Volume volume-1ab28413-3104-4237-93b5-31e02826c6bd is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:45.726656 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-1ab28413-3104-4237-93b5-31e02826c6bd {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:46.148184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Created reservations ['6c31a784-8ead-43a7-9bda-5eeedb842624', '76a743b1-2f0a-41fa-8eb7-0d4ffc2bff6d', 'f80da31c-43f7-432c-a0be-ea234d1bc573', '78018317-1e2f-4586-83b1-b5d8f484524c'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:46.282959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:46.370503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:46.460389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:46.472928 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:46.496430 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e75fd729-41ed-432b-b064-219497bdaace tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-1ab28413-3104-4237-93b5-31e02826c6bd-delete_volume'" released by "delete_volume" :: held 0.945s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:46.873459 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-de2c4dc9-745e-4a90-a045-998ffa1b5e6d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:46.991864 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:47.169603 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:47.179916 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:47.359551 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:30:47.360399 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:47.452707 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:47.528087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:47.534619 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:30:47.595187 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] deleting parent snapshot volume-de2c4dc9-745e-4a90-a045-998ffa1b5e6d.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:30:48.733208 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] Created reservations ['72211b26-4fbe-4bb6-9c03-1cfab7fa7de6', 'f1e01a73-6f57-45be-8d79-f8387a6a3171', 'bb0978f1-f68b-4dab-8268-80c7f4e53870', '0250239d-af0e-4aeb-9f6d-25f313400811'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:48.752930 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:UPDATE=19,cinder:INSERT=13,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:48.840457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:48.899758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:48.990414 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:48.995507 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:49.016452 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-d634b8e1-a015-4eb6-a700-c29416c52553 tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-de2c4dc9-745e-4a90-a045-998ffa1b5e6d-delete_volume'" released by "delete_volume" :: held 2.143s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:49.396090 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:30:49.539666 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:49.614807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:30:49.615665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Volume volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:30:49.627092 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] deleting rbd volume volume-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:30:49.653426 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:49.713851 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (a3105211-f0a0-4dd9-8305-bafb8fb06b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:49.737345 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd92419-f20b-45ed-a74a-3b5a47ebe9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:49.756804 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd92419-f20b-45ed-a74a-3b5a47ebe9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b31a782-a494-48cd-b94a-34ba19c64291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9416ab76-3b7f-4e92-9b8b-77c271a3bf8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:49Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:49.762662 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf7772-76f6-419d-b4be-6f4d674f2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:49.767232 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf7772-76f6-419d-b4be-6f4d674f2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:49.772997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7eff7f-f0aa-48ba-b8a2-029cde7fd189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:49.777828 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7eff7f-f0aa-48ba-b8a2-029cde7fd189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b31a782-a494-48cd-b94a-34ba19c64291', 'volume_name': 'volume-7b31a782-a494-48cd-b94a-34ba19c64291', 'volume_size': 1, 'snapshot_id': '9416ab76-3b7f-4e92-9b8b-77c271a3bf8f'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:49.783084 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bda6ba-9ea6-4659-97b9-e1bc02fadbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:49.788092 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bda6ba-9ea6-4659-97b9-e1bc02fadbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:49.800533 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65803ae8-7e76-4968-a16a-54c82717de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:49.802433 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Volume 7b31a782-a494-48cd-b94a-34ba19c64291: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b31a782-a494-48cd-b94a-34ba19c64291', 'volume_size': 1, 'snapshot_id': '9416ab76-3b7f-4e92-9b8b-77c271a3bf8f'} Jun 18 22:30:49.831185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] cloning volumes/volume-58b87a75-cb09-457c-9830-0d503bfb59bd@snapshot-9416ab76-3b7f-4e92-9b8b-77c271a3bf8f to volume-7b31a782-a494-48cd-b94a-34ba19c64291 {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:30:49.831959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:49.989332 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:50.102629 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Created reservations ['58f19599-d43f-4e9d-be5b-43b7687fae02', '7a1344cc-b723-409b-ae2e-0b2d8c349a0e', 'd50b8bb4-10eb-474e-a5fa-9c31ab616ad5', '4ecc8dad-1c52-4259-ad63-37c2b8265825'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:30:50.157773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:50.220595 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:50.261512 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:30:50.269927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:50.270427 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:50.281788 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Deleted volume successfully. Jun 18 22:30:50.294410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Marking volume 7b31a782-a494-48cd-b94a-34ba19c64291 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:30:50.313402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0dd166f5-1175-467c-a596-d65256d0880f tempest-VolumesGetTest-1169044513 None] Lock "b'cinder-fd692f47-d055-43d3-8d2d-ca0f30fdf0e7-delete_volume'" released by "delete_volume" :: held 0.915s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:30:50.315134 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from snapshot 9416ab76-3b7f-4e92-9b8b-77c271a3bf8f to 7b31a782-a494-48cd-b94a-34ba19c64291. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 18 22:30:50.350578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65803ae8-7e76-4968-a16a-54c82717de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b31a782-a494-48cd-b94a-34ba19c64291', 'volume_size': 1, 'snapshot_id': '9416ab76-3b7f-4e92-9b8b-77c271a3bf8f'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:50.355444 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617416f8-fa4c-478f-8a2b-83189aad2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:50.366224 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Volume volume-7b31a782-a494-48cd-b94a-34ba19c64291 (7b31a782-a494-48cd-b94a-34ba19c64291): created successfully Jun 18 22:30:50.370117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617416f8-fa4c-478f-8a2b-83189aad2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:50.375655 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (a3105211-f0a0-4dd9-8305-bafb8fb06b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:50.390752 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-c56ff6f5-5601-42c8-8451-bb18048a063e tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:30:53.036762 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-f03997aa-0d98-444e-b32f-f09647589cba tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:30:54.362635 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-f03997aa-0d98-444e-b32f-f09647589cba tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.328s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:30:54.363451 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-f03997aa-0d98-444e-b32f-f09647589cba tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b31a782-a494-48cd-b94a-34ba19c64291', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '7b31a782-a494-48cd-b94a-34ba19c64291', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:30:54.395299 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=52,cinder:INSERT=13,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:54.410915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-f03997aa-0d98-444e-b32f-f09647589cba tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-7b31a782-a494-48cd-b94a-34ba19c64291', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b31a782-a494-48cd-b94a-34ba19c64291', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7bd54034-3aa4-44b7-a578-4d4ea49ecec3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:30:54.584675 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4b8175b1-4f45-4a04-828f-6b21edda06f5 req-f03997aa-0d98-444e-b32f-f09647589cba tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:30:58.741423 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:58.769694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Flow 'volume_create_manager' (eba230d5-beaf-4cb1-a534-d1a24adcc82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:58.778310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0489430-c84d-400f-8210-040f5879fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:58.802202 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0489430-c84d-400f-8210-040f5879fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1188927271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5e9255a-40fb-46cc-bf1c-43fa0085ef2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29c1f8c82714c84861bdc73a75348da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:59Z,use_quota=True,user_id='0dd8db30c736405e80ccc09e59d46f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(820aba23-3e74-4780-b39f-797359ef946a),volume_type_id=820aba23-3e74-4780-b39f-797359ef946a)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:58.816765 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f9793-7ab1-44c8-bab5-16a200f3e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:58.825898 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f9793-7ab1-44c8-bab5-16a200f3e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:58.835160 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a482be2-7f5d-4315-afe2-8398c9d40c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:58.840320 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a482be2-7f5d-4315-afe2-8398c9d40c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e9255a-40fb-46cc-bf1c-43fa0085ef2e', 'volume_name': 'volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:58.845774 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200efc5c-d56f-4ae9-a873-4a318e4d1754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:58.851942 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200efc5c-d56f-4ae9-a873-4a318e4d1754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:58.856993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fd9ede-afcc-4ad2-9285-9099379464ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:58.858392 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Volume b5e9255a-40fb-46cc-bf1c-43fa0085ef2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e', 'volume_size': 1} Jun 18 22:30:58.859276 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] creating volume 'volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:58.860555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:59.039473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:59.040185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:59.045764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fd9ede-afcc-4ad2-9285-9099379464ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.052300 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244a6749-172d-4f02-ba2a-ad44291bdb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.092099 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Volume volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e (b5e9255a-40fb-46cc-bf1c-43fa0085ef2e): created successfully Jun 18 22:30:59.097779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244a6749-172d-4f02-ba2a-ad44291bdb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.105601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Flow 'volume_create_manager' (eba230d5-beaf-4cb1-a534-d1a24adcc82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:59.115666 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:30:59.139948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (7213180d-7349-49d6-907e-9f006f487780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:59.148185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d90230-df0b-4f59-98f4-1bc0ea011d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.162721 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8f4f815d-94d6-4788-8180-e624f3c3e6a3 tempest-VolumeTypesTest-276693010 None] Created volume successfully. Jun 18 22:30:59.174368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d90230-df0b-4f59-98f4-1bc0ea011d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1798596555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bb96dac-d22f-48b7-8475-af7c0c8e42d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:30:59Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.186077 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e76966-a2a0-4126-aa7b-03d6ee4b9f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.231048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e76966-a2a0-4126-aa7b-03d6ee4b9f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.245515 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26928ce-ce7b-4857-8772-cc4d637d3b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.250757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26928ce-ce7b-4857-8772-cc4d637d3b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'volume_name': 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.258407 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c147c9ad-57d5-4939-803c-d86f8c29d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.263429 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c147c9ad-57d5-4939-803c-d86f8c29d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.274286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d61ab5-08db-4a49-8a59-9fb77c18d373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.278173 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Volume 0bb96dac-d22f-48b7-8475-af7c0c8e42d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'volume_size': 1} Jun 18 22:30:59.278615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] creating volume 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:30:59.279298 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:30:59.387843 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:30:59.388809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:30:59.394012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d61ab5-08db-4a49-8a59-9fb77c18d373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.398850 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d26b57-c3f8-4e56-923e-5dc0c8a53e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:30:59.431208 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2 (0bb96dac-d22f-48b7-8475-af7c0c8e42d2): created successfully Jun 18 22:30:59.436429 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d26b57-c3f8-4e56-923e-5dc0c8a53e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:30:59.442493 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (7213180d-7349-49d6-907e-9f006f487780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:30:59.456067 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e30077e2-f7ff-4841-af04-677c3b5724da tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:31:00.140414 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f251df73-a737-45c8-ac3b-3158cc8cb6a9 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:00.217421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-f251df73-a737-45c8-ac3b-3158cc8cb6a9 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:00.298261 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-f251df73-a737-45c8-ac3b-3158cc8cb6a9 tempest-VolumeTypesTest-276693010 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:00.302556 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-f251df73-a737-45c8-ac3b-3158cc8cb6a9 tempest-VolumeTypesTest-276693010 None] Retype volume completed successfully. Jun 18 22:31:00.428532 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=25,cinder:SELECT=65,cinder:INSERT=8,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:00.453876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a9f28031-a6af-454e-8069-2306877f5487 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:00.859960 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a9f28031-a6af-454e-8069-2306877f5487 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:31:01.974120 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.driver [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Creating a new backup for volume volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2. {{(pid=123873) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} Jun 18 22:31:02.034800 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] cloning volumes/volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2@snapshot-92c8fd42-8bc0-49e1-9cc0-424f61d17e4b to volume-8d6b610a-80ae-4fa0-9c29-0e33db3b191b {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:31:02.037213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:02.110701 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:02.273737 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:02.274185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:02.310936 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:31:01Z,data_timestamp=2022-06-18T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-784499451',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bb5cf546-2c9c-4eea-963e-c7f45d138bda,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='92c8fd42-8bc0-49e1-9cc0-424f61d17e4b',status='creating',temp_snapshot_id=None,temp_volume_id='8d6b610a-80ae-4fa0-9c29-0e33db3b191b',updated_at=None,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_id=0bb96dac-d22f-48b7-8475-af7c0c8e42d2) Jun 18 22:31:02.312197 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] continue_backup in rpcapi backup_id bb5cf546-2c9c-4eea-963e-c7f45d138bda {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:31:02.608966 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:02.804421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Lock "b'cinder-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:02.878412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:02.958538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:02.958986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Volume volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:02.966093 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] deleting rbd volume volume-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:03.273565 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-2145116454 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-2145116454, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:31:03.275148 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-2145116454 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-2145116454, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:31:03.295902 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Created reservations ['021c3884-f60a-4a99-920c-b73b6d893c07', '3b29d69e-1fef-4029-86fd-b3912f66e7e3', '2c5f64d6-a547-4fc1-81f0-a04840140e6f', '9db9e81a-a9c3-4778-af67-bd91c2d6b834'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:03.380518 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:03.449166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:03.519685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:03.525791 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Deleted volume successfully. Jun 18 22:31:03.581019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-10aa983f-3107-4542-9d7c-8c4986a538d5 tempest-VolumeTypesTest-276693010 None] Lock "b'cinder-b5e9255a-40fb-46cc-bf1c-43fa0085ef2e-delete_volume'" released by "delete_volume" :: held 0.777s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:03.784555 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.176s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:03.785792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '8d6b610a-80ae-4fa0-9c29-0e33db3b191b', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:03.801753 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Initialize volume connection completed successfully. Jun 18 22:31:11.605056 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-85954cce-5651-4b80-8e37-88a300027d71 req-ec80ee0d-eadb-4b1f-90ae-89452ec95088 tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:31:11.625673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-85954cce-5651-4b80-8e37-88a300027d71 req-ec80ee0d-eadb-4b1f-90ae-89452ec95088 tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment 7bd54034-3aa4-44b7-a578-4d4ea49ecec3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:31:11.987465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-7b31a782-a494-48cd-b94a-34ba19c64291-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:12.150445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:12.345109 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:12.360124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-7b31a782-a494-48cd-b94a-34ba19c64291 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:12.882445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['5cdcbafc-4018-4798-b27c-0f905cd6a675', '3cdee44a-2359-45d1-bdb5-e5f412f41782', 'a9a34662-b80c-4dd2-9fb9-cbe265591ffb', '8e92c5ce-eab2-43ac-aba4-cab2c3516c02'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:13.013644 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:13.145176 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:13.233344 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:13.261268 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:31:13.309835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-85954cce-5651-4b80-8e37-88a300027d71 req-60b86ae2-2b4e-49ce-95a3-16801765dbe1 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-7b31a782-a494-48cd-b94a-34ba19c64291-delete_volume'" released by "delete_volume" :: held 1.333s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:13.926314 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-039ffd61-c877-46ec-a919-3161d1eef88b tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-9416ab76-3b7f-4e92-9b8b-77c271a3bf8f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:13.929139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-039ffd61-c877-46ec-a919-3161d1eef88b tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:14.827216 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:14.938818 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-039ffd61-c877-46ec-a919-3161d1eef88b tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['4a007762-a676-4df8-9c93-df2b9834595c', 'f6e18d5c-c95f-4e1e-a56f-55adfa75b581', '0f87e54e-ae6c-4676-8859-468fefb0026d', '77dfc5d5-3690-45fc-91c8-48beaff32946'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:15.042382 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-039ffd61-c877-46ec-a919-3161d1eef88b tempest-TestVolumeBootPattern-2084543740 None] Delete snapshot completed successfully. Jun 18 22:31:15.049265 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-039ffd61-c877-46ec-a919-3161d1eef88b tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-9416ab76-3b7f-4e92-9b8b-77c271a3bf8f-delete_snapshot'" released by "delete_snapshot" :: held 1.142s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:16.196036 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-58b87a75-cb09-457c-9830-0d503bfb59bd-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:16.334051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:16.453931 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:16.466357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-58b87a75-cb09-457c-9830-0d503bfb59bd {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:16.880834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:31:16.988499 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] deleting parent snapshot volume-58b87a75-cb09-457c-9830-0d503bfb59bd.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:31:18.067268 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['eb014432-de30-47d9-9589-097dfee93d00', 'ec2d83da-bb89-4b22-ac5a-244370e01e15', '33c937bd-cecf-4d5b-b48d-c2ef4b6aefa8', 'cda547eb-cb38-43e7-8681-8afd0e9b27c9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:18.124071 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:18.154752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:18.247228 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:18.333826 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:18.367509 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Terminate volume connection completed successfully. Jun 18 22:31:18.375204 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:31:18.399876 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Remove volume export completed successfully. Jun 18 22:31:18.426133 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fe411da5-22e9-4ee2-a6a7-d052baa04271 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-58b87a75-cb09-457c-9830-0d503bfb59bd-delete_volume'" released by "delete_volume" :: held 2.231s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:18.490632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-8d6b610a-80ae-4fa0-9c29-0e33db3b191b-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:18.547208 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:18.665950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:18.690363 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-8d6b610a-80ae-4fa0-9c29-0e33db3b191b {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:18.830746 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:18.885970 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Flow 'volume_create_manager' (0d963e1b-fcfb-480e-80cf-cbff762e6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:18.902087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38787e17-46e3-45ea-85ed-53e719a997fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:18.933460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38787e17-46e3-45ea-85ed-53e719a997fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-316302298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5861b04e-53ec-47ed-937c-5d5ac1c5c31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45dc8c8953c47e0b50cbacc9fcac9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:19Z,use_quota=True,user_id='e0c6b9900e5d4990949858b319446ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:18.966539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d157229-96c0-49d0-b8d9-edb493451c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:18.991279 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d157229-96c0-49d0-b8d9-edb493451c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.011710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cec91b1-f6c4-4670-97ed-f74d7df7c8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.027193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cec91b1-f6c4-4670-97ed-f74d7df7c8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5861b04e-53ec-47ed-937c-5d5ac1c5c31c', 'volume_name': 'volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.041975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5890ab91-1bc1-4d24-88d4-65ccfa6b6719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.051143 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5890ab91-1bc1-4d24-88d4-65ccfa6b6719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.057101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1635ee44-7c64-4769-a410-a91e70734e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.060096 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Volume 5861b04e-53ec-47ed-937c-5d5ac1c5c31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c', 'volume_size': 1} Jun 18 22:31:19.060842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] creating volume 'volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:19.062119 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:19.154298 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:31:19.159582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6ac0cb0b-b65d-4e49-ace5-09ad670d63e3 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-8d6b610a-80ae-4fa0-9c29-0e33db3b191b-delete_volume'" released by "delete_volume" :: held 0.669s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:19.174632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:19.175269 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:19.180118 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1635ee44-7c64-4769-a410-a91e70734e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.190794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36e00e-5964-4d3a-8fa4-7e88194fcda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.207989 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Volume volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c (5861b04e-53ec-47ed-937c-5d5ac1c5c31c): created successfully Jun 18 22:31:19.219684 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36e00e-5964-4d3a-8fa4-7e88194fcda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.230792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Flow 'volume_create_manager' (0d963e1b-fcfb-480e-80cf-cbff762e6f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:19.250550 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-2c03969d-1637-4dc7-b54e-57003100e79f tempest-VolumesTransfersTest-97016794 None] Created volume successfully. Jun 18 22:31:19.587616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:19.610130 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (f92adff7-a81d-44d4-bef4-544bd1978d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:19.617442 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe02d21-85c0-44f8-9964-2a8f5610028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.640086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe02d21-85c0-44f8-9964-2a8f5610028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-540831551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f117025-1ed5-4e5a-a29d-470d49e0c8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:20Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.649719 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906d5297-34f9-430a-abc5-f49cb8d40e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.663884 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906d5297-34f9-430a-abc5-f49cb8d40e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.670131 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897514bc-98f5-440d-8ffe-6d902f9a9623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.794173 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897514bc-98f5-440d-8ffe-6d902f9a9623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'volume_name': 'volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.802537 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f94de2e-b0d7-4e37-9419-b6ffb82162bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.812512 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f94de2e-b0d7-4e37-9419-b6ffb82162bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:19.822562 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46739b3b-1d09-4f96-b012-35f6f4400ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:19.823577 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Volume 2f117025-1ed5-4e5a-a29d-470d49e0c8c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:31:19.824325 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Cloning 2f117025-1ed5-4e5a-a29d-470d49e0c8c5 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:31:19.841273 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:19.858092 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 31, 19, 848111)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:31:19.858954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:31:19.859485 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:31:19.868076 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:19.869713 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:31:19.888389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 31, 19, 879287)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:31:19.889342 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:31:19.890614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:31:19.933750 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:20.083071 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] creating snapshot='volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:31:20.610583 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5.clone_snap' to 'volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:31:20.634570 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ec908ac6-80f1-461a-b425-334a69cf7457 tempest-VolumesTransfersTest-819420275 None] Transfer volume completed successfully. Jun 18 22:31:20.790162 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:20.792341 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:20.792916 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:20.826975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:31:20.827243 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Marking volume 2f117025-1ed5-4e5a-a29d-470d49e0c8c5 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:31:20.845402 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 2f117025-1ed5-4e5a-a29d-470d49e0c8c5. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:31:20.846016 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Creating volume glance metadata for volume 2f117025-1ed5-4e5a-a29d-470d49e0c8c5 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:31:20.916126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46739b3b-1d09-4f96-b012-35f6f4400ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:20.921321 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106f09be-5b3d-467b-a023-28685534d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:20.935104 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Volume volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5 (2f117025-1ed5-4e5a-a29d-470d49e0c8c5): created successfully Jun 18 22:31:20.940209 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106f09be-5b3d-467b-a023-28685534d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:20.948051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (f92adff7-a81d-44d4-bef4-544bd1978d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:20.963078 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-46d47ff3-bf62-4a47-ba61-14f209f8d7de tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:31:21.113193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Lock "b'cinder-5861b04e-53ec-47ed-937c-5d5ac1c5c31c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:21.197887 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:21.270464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:21.271135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Volume volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:21.279900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] deleting rbd volume volume-5861b04e-53ec-47ed-937c-5d5ac1c5c31c {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:21.721766 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Created reservations ['b09197da-6131-465a-a431-da2bbaaada07', '7e107557-5ff5-4c1d-9795-ce7937574fd7', 'f04b4e88-1ac2-4b1f-b71f-90b715c72653', 'c47fb31a-306d-454f-bdbe-d2a7233a7136'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:21.762149 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=51,cinder:INSERT=14,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:21.830939 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:21.880468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:21.941976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:21.952427 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Deleted volume successfully. Jun 18 22:31:21.975003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-97d19717-857d-4bff-9b9f-ea036fa80ff1 tempest-VolumesTransfersTest-163225141 None] Lock "b'cinder-5861b04e-53ec-47ed-937c-5d5ac1c5c31c-delete_volume'" released by "delete_volume" :: held 0.862s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:22.838041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:22.884984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Flow 'volume_create_manager' (2079239e-ed57-48f4-9f0b-bd6102f6e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:22.900788 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90e65dc-6cb6-45d9-8ace-a20eb33a7b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:22.921258 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90e65dc-6cb6-45d9-8ace-a20eb33a7b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1953482780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c0ccaa1-34fc-44dd-bd38-378f43126368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45dc8c8953c47e0b50cbacc9fcac9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:23Z,use_quota=True,user_id='e0c6b9900e5d4990949858b319446ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:22.935101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c97cd4-eb53-4c2e-9f92-743b2ea02cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:22.939971 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c97cd4-eb53-4c2e-9f92-743b2ea02cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:22.945758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977c132b-c6cd-4194-8b39-8b200e8639d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:22.950242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977c132b-c6cd-4194-8b39-8b200e8639d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0ccaa1-34fc-44dd-bd38-378f43126368', 'volume_name': 'volume-7c0ccaa1-34fc-44dd-bd38-378f43126368', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:22.956212 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b40371-ef4c-49ff-95c0-12660599efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:22.960497 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b40371-ef4c-49ff-95c0-12660599efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:22.965184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee9a810-b91e-423a-ba08-26f3ada5d62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:22.966467 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Volume 7c0ccaa1-34fc-44dd-bd38-378f43126368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0ccaa1-34fc-44dd-bd38-378f43126368', 'volume_size': 1} Jun 18 22:31:22.966971 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] creating volume 'volume-7c0ccaa1-34fc-44dd-bd38-378f43126368' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:22.967816 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:23.063210 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:23.063634 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:23.067377 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee9a810-b91e-423a-ba08-26f3ada5d62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0ccaa1-34fc-44dd-bd38-378f43126368', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:23.072594 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed8048c-dba5-49fe-8f1e-2be994f039c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:23.086262 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Volume volume-7c0ccaa1-34fc-44dd-bd38-378f43126368 (7c0ccaa1-34fc-44dd-bd38-378f43126368): created successfully Jun 18 22:31:23.090664 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed8048c-dba5-49fe-8f1e-2be994f039c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:23.096943 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Flow 'volume_create_manager' (2079239e-ed57-48f4-9f0b-bd6102f6e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:23.107744 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-35e3b777-fead-48db-bada-b217943892a0 tempest-VolumesTransfersTest-97016794 None] Created volume successfully. Jun 18 22:31:24.795468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Lock "b'cinder-7c0ccaa1-34fc-44dd-bd38-378f43126368-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:24.882391 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:24.963306 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (8981ff31-ff51-4c80-ad29-d41a32bdd3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:24.971601 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84edad2c-93e1-4a2a-b53e-e86940f72948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:24.988623 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:25.094735 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:25.095172 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Volume volume-7c0ccaa1-34fc-44dd-bd38-378f43126368 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:25.104446 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] deleting rbd volume volume-7c0ccaa1-34fc-44dd-bd38-378f43126368 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:25.128485 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84edad2c-93e1-4a2a-b53e-e86940f72948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1914244768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=391fe876-11d6-4b7c-b0cf-c698bbac3b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76301551c4574f299511a993dc871890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:25Z,use_quota=True,user_id='3f6133e6ab7745118bc629dd126189e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.139290 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6072a4-b0a1-4898-8041-5a294bc73c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:25.152111 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6072a4-b0a1-4898-8041-5a294bc73c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.162069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d789bb-dde1-4651-8258-76bf50f26ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:25.186568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d789bb-dde1-4651-8258-76bf50f26ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'volume_name': 'volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.206917 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd35c8d2-983f-4201-942d-b412a1861aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:25.222081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd35c8d2-983f-4201-942d-b412a1861aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.230757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc65c1-3359-42f2-997f-aa7811e7b333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:25.232957 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Volume 391fe876-11d6-4b7c-b0cf-c698bbac3b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'volume_size': 1} Jun 18 22:31:25.233859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] creating volume 'volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:25.234768 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:25.407994 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:25.408864 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:25.413608 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc65c1-3359-42f2-997f-aa7811e7b333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.419994 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0678de72-fd5d-43f7-83a4-095956854cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:25.439131 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Volume volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21 (391fe876-11d6-4b7c-b0cf-c698bbac3b21): created successfully Jun 18 22:31:25.446235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0678de72-fd5d-43f7-83a4-095956854cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:25.455867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (8981ff31-ff51-4c80-ad29-d41a32bdd3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:25.487129 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4bfdd27d-1e6b-43b9-bff5-85569ef77ad9 tempest-AttachVolumeTestJSON-223712319 None] Created volume successfully. Jun 18 22:31:25.561736 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Created reservations ['669a2109-0853-446d-8aae-f1b1b5b5bc4b', 'ea049538-87a9-445f-9089-c02eba765211', '82177545-f6e5-4b05-a2d0-94badaaf30f5', 'df1fb12d-80a0-42e9-912a-08e422472bd3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:25.654841 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:25.729127 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:25.778314 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:25.784867 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Deleted volume successfully. Jun 18 22:31:25.807577 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c997275c-95bd-437e-a12f-d95dd32f2925 tempest-VolumesTransfersTest-163225141 None] Lock "b'cinder-7c0ccaa1-34fc-44dd-bd38-378f43126368-delete_volume'" released by "delete_volume" :: held 1.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:26.475092 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb req-f42c0abc-5352-4c1b-bde1-68e4e5a0184c tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:26.951401 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-940568b7-fc80-41a4-9b0d-f015e2996fc3 req-ef4a69cd-7c54-4b33-a72a-5c2ad920d0c7 tempest-AttachVolumeTestJSON-223712319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:27.843856 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb req-f42c0abc-5352-4c1b-bde1-68e4e5a0184c tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.368s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:27.845250 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb req-f42c0abc-5352-4c1b-bde1-68e4e5a0184c tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:27.883591 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=59,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:27.900665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb req-f42c0abc-5352-4c1b-bde1-68e4e5a0184c tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f117025-1ed5-4e5a-a29d-470d49e0c8c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c2b27c22-9715-44d2-95ec-f2f33c7665e3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:28.032136 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb req-f42c0abc-5352-4c1b-bde1-68e4e5a0184c tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:31:28.086744 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-940568b7-fc80-41a4-9b0d-f015e2996fc3 req-ef4a69cd-7c54-4b33-a72a-5c2ad920d0c7 tempest-AttachVolumeTestJSON-223712319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.138s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:28.087872 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-940568b7-fc80-41a4-9b0d-f015e2996fc3 req-ef4a69cd-7c54-4b33-a72a-5c2ad920d0c7 tempest-AttachVolumeTestJSON-223712319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:28.128121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-940568b7-fc80-41a4-9b0d-f015e2996fc3 req-ef4a69cd-7c54-4b33-a72a-5c2ad920d0c7 tempest-AttachVolumeTestJSON-223712319 None] Connection info returned from driver {'name': 'volumes/volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '391fe876-11d6-4b7c-b0cf-c698bbac3b21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1283d2e2-5a09-497a-a237-19ceea3d60bc'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:28.235702 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-940568b7-fc80-41a4-9b0d-f015e2996fc3 req-ef4a69cd-7c54-4b33-a72a-5c2ad920d0c7 tempest-AttachVolumeTestJSON-223712319 None] attachment_update completed successfully. Jun 18 22:31:31.159927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:31.213468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (58cd73cc-1717-491b-a8fd-042e98d3495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:31.230596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f35297-7377-48b9-86bb-dccbd1e7381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.282869 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f35297-7377-48b9-86bb-dccbd1e7381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-745619003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=18ebce1b-b229-419b-9410-7cece8102bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76301551c4574f299511a993dc871890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:31Z,use_quota=True,user_id='3f6133e6ab7745118bc629dd126189e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.296293 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113889c9-9c74-44ee-a168-61e01174e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.325283 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113889c9-9c74-44ee-a168-61e01174e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.344780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe5a1b9-55f5-4819-96a8-a917187a511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.362043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe5a1b9-55f5-4819-96a8-a917187a511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ebce1b-b229-419b-9410-7cece8102bf1', 'volume_name': 'volume-18ebce1b-b229-419b-9410-7cece8102bf1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.370560 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d8d73-b05d-4903-bb9e-c33db0e44e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.375029 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d8d73-b05d-4903-bb9e-c33db0e44e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.383179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c6d840-4231-465f-9071-a4232674f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.384668 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Volume 18ebce1b-b229-419b-9410-7cece8102bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ebce1b-b229-419b-9410-7cece8102bf1', 'volume_size': 1} Jun 18 22:31:31.385369 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] creating volume 'volume-18ebce1b-b229-419b-9410-7cece8102bf1' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:31.386857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:31.490528 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:31.491357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:31.495436 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c6d840-4231-465f-9071-a4232674f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ebce1b-b229-419b-9410-7cece8102bf1', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.500529 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9a480a-f800-449b-829f-7a0c617f54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:31.515264 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Volume volume-18ebce1b-b229-419b-9410-7cece8102bf1 (18ebce1b-b229-419b-9410-7cece8102bf1): created successfully Jun 18 22:31:31.520194 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9a480a-f800-449b-829f-7a0c617f54a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:31.528581 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Flow 'volume_create_manager' (58cd73cc-1717-491b-a8fd-042e98d3495b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:31.548847 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0de40a2f-3414-49f3-bce1-160eb6e63e2f tempest-AttachVolumeTestJSON-223712319 None] Created volume successfully. Jun 18 22:31:32.951905 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-73a1a2d5-f773-4ba9-9879-28b63aaff734 req-12c63689-5a02-4122-a16f-597f42563409 tempest-AttachVolumeTestJSON-223712319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:33.591232 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:33.619129 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (1e6154c1-87b6-46f0-a068-7d96132e4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:33.626643 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a30d044-f4f1-408b-bb69-adcbaabd08b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.661476 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a30d044-f4f1-408b-bb69-adcbaabd08b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-949780281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e6040aa-afe5-48b7-82e1-848690284862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:34Z,use_quota=True,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.667253 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26437687-4474-480e-a6fa-87ec38df4004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.671836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26437687-4474-480e-a6fa-87ec38df4004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.677998 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b300de7a-b026-4873-a671-74d8b48b230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.683096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b300de7a-b026-4873-a671-74d8b48b230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'volume_name': 'volume-0e6040aa-afe5-48b7-82e1-848690284862', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.690451 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d5e8d1-25e8-4145-b5b8-5b58203e0566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.697328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d5e8d1-25e8-4145-b5b8-5b58203e0566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.702875 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce91854-2569-49f6-87ca-f3cba8be3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.704333 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Volume 0e6040aa-afe5-48b7-82e1-848690284862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6040aa-afe5-48b7-82e1-848690284862', 'volume_size': 1} Jun 18 22:31:33.705065 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] creating volume 'volume-0e6040aa-afe5-48b7-82e1-848690284862' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:33.706184 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:33.784584 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:33.784971 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:33.789097 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce91854-2569-49f6-87ca-f3cba8be3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6040aa-afe5-48b7-82e1-848690284862', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.793077 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f971d58-0ea1-4864-8d47-5529a91f2297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:33.804987 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Volume volume-0e6040aa-afe5-48b7-82e1-848690284862 (0e6040aa-afe5-48b7-82e1-848690284862): created successfully Jun 18 22:31:33.810503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f971d58-0ea1-4864-8d47-5529a91f2297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:33.818353 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (1e6154c1-87b6-46f0-a068-7d96132e4042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:33.831086 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-18d388a7-c2f5-4bdc-a26c-8df3c1f53a39 tempest-VolumesBackupsTest-624856523 None] Created volume successfully. Jun 18 22:31:34.090716 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-73a1a2d5-f773-4ba9-9879-28b63aaff734 req-12c63689-5a02-4122-a16f-597f42563409 tempest-AttachVolumeTestJSON-223712319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.142s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:34.092338 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-73a1a2d5-f773-4ba9-9879-28b63aaff734 req-12c63689-5a02-4122-a16f-597f42563409 tempest-AttachVolumeTestJSON-223712319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18ebce1b-b229-419b-9410-7cece8102bf1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '18ebce1b-b229-419b-9410-7cece8102bf1', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:34.130194 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-73a1a2d5-f773-4ba9-9879-28b63aaff734 req-12c63689-5a02-4122-a16f-597f42563409 tempest-AttachVolumeTestJSON-223712319 None] Connection info returned from driver {'name': 'volumes/volume-18ebce1b-b229-419b-9410-7cece8102bf1', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18ebce1b-b229-419b-9410-7cece8102bf1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2a294606-501c-404c-99ad-2b719d453856'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:34.186483 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-73a1a2d5-f773-4ba9-9879-28b63aaff734 req-12c63689-5a02-4122-a16f-597f42563409 tempest-AttachVolumeTestJSON-223712319 None] attachment_update completed successfully. Jun 18 22:31:37.519197 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3824b315-4a44-4d31-91fe-655c3f317e37 req-c425a43e-1f3c-4f06-8880-2113c9c12496 tempest-AttachVolumeTestJSON-223712319 None] Terminate volume connection completed successfully. Jun 18 22:31:37.519795 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-3824b315-4a44-4d31-91fe-655c3f317e37 req-c425a43e-1f3c-4f06-8880-2113c9c12496 tempest-AttachVolumeTestJSON-223712319 None] Deleting attachment 1283d2e2-5a09-497a-a237-19ceea3d60bc. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:31:39.018655 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-796f94f7-208f-453d-a7b6-096ac7b54e20 req-3a2609c1-b029-44e6-84fa-f797acd811ad tempest-AttachVolumeTestJSON-223712319 None] Terminate volume connection completed successfully. Jun 18 22:31:39.019291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-796f94f7-208f-453d-a7b6-096ac7b54e20 req-3a2609c1-b029-44e6-84fa-f797acd811ad tempest-AttachVolumeTestJSON-223712319 None] Deleting attachment 2a294606-501c-404c-99ad-2b719d453856. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:31:40.722548 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e4b75f4d-3fc0-45cc-8c05-fb9f7f65b1c5 tempest-BackendsCapabilitiesAdminTestsJSON-847810423 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:41e1b3da-5658-4f78-a875-e600b926dd2b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123873) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}} Jun 18 22:31:40.779590 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-69d4acf5-0c6d-49fd-99b0-3cc7191c0e6e tempest-BackendsCapabilitiesAdminTestsJSON-847810423 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:41e1b3da-5658-4f78-a875-e600b926dd2b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=123873) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}} Jun 18 22:31:44.598517 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:44.644744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (1a78ab3d-d8f6-427e-bcbf-7c5b9de5e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:44.655816 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee88f75-1c5d-4732-af79-139ab59250cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:44.720890 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee88f75-1c5d-4732-af79-139ab59250cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-712256479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6719241-2450-4c57-9569-6470077a1b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:45Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:44.735110 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eefaaff-f749-4232-b69a-f180d5ba131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:44.756650 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eefaaff-f749-4232-b69a-f180d5ba131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:44.773626 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87455217-6a17-459f-86ab-6c3ba923e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:44.926161 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87455217-6a17-459f-86ab-6c3ba923e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6719241-2450-4c57-9569-6470077a1b0e', 'volume_name': 'volume-f6719241-2450-4c57-9569-6470077a1b0e', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:44.931372 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55788f2e-414e-4214-ac4b-14ad228d93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:44.949967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55788f2e-414e-4214-ac4b-14ad228d93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:44.966255 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ad9940-6a8d-4a6e-8329-4799846f4492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:44.967433 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume f6719241-2450-4c57-9569-6470077a1b0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6719241-2450-4c57-9569-6470077a1b0e', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:31:44.968019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Cloning f6719241-2450-4c57-9569-6470077a1b0e from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:31:44.992831 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:45.018728 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 31, 44, 999685)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:31:45.019495 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:31:45.020070 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:31:45.025336 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:45.026531 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:31:45.044730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 31, 45, 41986)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:31:45.045172 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:31:45.045806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:31:45.060148 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:45.146073 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] creating snapshot='volume-f6719241-2450-4c57-9569-6470077a1b0e.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:31:45.683784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-f6719241-2450-4c57-9569-6470077a1b0e.clone_snap' to 'volume-f6719241-2450-4c57-9569-6470077a1b0e' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:31:45.856423 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:45.858006 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:45.858405 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:45.892695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:31:45.893691 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Marking volume f6719241-2450-4c57-9569-6470077a1b0e as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:31:45.905568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to f6719241-2450-4c57-9569-6470077a1b0e. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:31:45.906291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Creating volume glance metadata for volume f6719241-2450-4c57-9569-6470077a1b0e backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:31:45.923851 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=79,cinder:DELETE=2,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:46.039466 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ad9940-6a8d-4a6e-8329-4799846f4492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6719241-2450-4c57-9569-6470077a1b0e', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:46.059197 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a381455c-b8e5-4e72-8f8f-922e8b9a4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:46.080709 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-f6719241-2450-4c57-9569-6470077a1b0e (f6719241-2450-4c57-9569-6470077a1b0e): created successfully Jun 18 22:31:46.086829 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a381455c-b8e5-4e72-8f8f-922e8b9a4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:46.096370 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (1a78ab3d-d8f6-427e-bcbf-7c5b9de5e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:46.107115 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cc0ee5af-ca86-4668-8a64-2ac84c9249e8 tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:31:47.086912 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-97560a52-d193-4cfb-8441-6e5656afe217 req-6fff5ed3-f392-44d5-a988-065073e96dd5 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:47.260395 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-39bfe728-a4ec-45fc-9d19-e22684d35b2f tempest-GroupsV314Test-1207482755 None] Group tempest-GroupsV314Test-Group-1921444606: creating Jun 18 22:31:47.322677 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-39bfe728-a4ec-45fc-9d19-e22684d35b2f tempest-GroupsV314Test-1207482755 None] Group tempest-GroupsV314Test-Group-1921444606: created successfully Jun 18 22:31:47.338874 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-39bfe728-a4ec-45fc-9d19-e22684d35b2f tempest-GroupsV314Test-1207482755 None] Create group completed successfully. Jun 18 22:31:47.369787 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:31:47.370529 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:47.466614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:47.568479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:47.860455 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=70,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=13 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:47.870864 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-dbacd13b-b807-45ae-b1c6-289647a7e414 req-adedeed7-c1b1-4465-9e92-89237588b4a2 tempest-VolumesSnapshotTestJSON-1142548725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:47.956980 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-97560a52-d193-4cfb-8441-6e5656afe217 req-6fff5ed3-f392-44d5-a988-065073e96dd5 tempest-TestVolumeBootPattern-2084543740 None] Create snapshot completed successfully Jun 18 22:31:48.949473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:49.000582 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Flow 'volume_create_manager' (f7aca8c3-8f37-4367-9945-93df214d52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:49.026551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095223de-fda9-44f9-93de-5c21f58dba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.077866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095223de-fda9-44f9-93de-5c21f58dba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-308241274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bb8f979-ae26-49fe-9a95-98fd3a68f863,host='ncdv-master-1@ceph#ceph',id=6d80424d-fadb-4414-a17c-fc87b37c4294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8a6af1730648f59aad868ff855fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:49Z,use_quota=True,user_id='9ad1cbaef41944979c96491cd297e4f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b485829-1cf8-4b77-bd0c-67b4e02b6734),volume_type_id=7b485829-1cf8-4b77-bd0c-67b4e02b6734)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.095613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691be117-e76a-436c-992f-b33605917c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.107195 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691be117-e76a-436c-992f-b33605917c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.120857 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecd422-d3da-47b7-865e-5a4bac1894a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.130044 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecd422-d3da-47b7-865e-5a4bac1894a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d80424d-fadb-4414-a17c-fc87b37c4294', 'volume_name': 'volume-6d80424d-fadb-4414-a17c-fc87b37c4294', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.140371 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9942cbd9-213e-4841-8186-535f19c80aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.160896 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9942cbd9-213e-4841-8186-535f19c80aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.160896 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a980ddd4-6f65-4456-b9a7-a6b500178227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.169788 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Volume 6d80424d-fadb-4414-a17c-fc87b37c4294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d80424d-fadb-4414-a17c-fc87b37c4294', 'volume_size': 1} Jun 18 22:31:49.170616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] creating volume 'volume-6d80424d-fadb-4414-a17c-fc87b37c4294' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:31:49.173595 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:49.259099 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-dbacd13b-b807-45ae-b1c6-289647a7e414 req-adedeed7-c1b1-4465-9e92-89237588b4a2 tempest-VolumesSnapshotTestJSON-1142548725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.388s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:49.260702 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-dbacd13b-b807-45ae-b1c6-289647a7e414 req-adedeed7-c1b1-4465-9e92-89237588b4a2 tempest-VolumesSnapshotTestJSON-1142548725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6719241-2450-4c57-9569-6470077a1b0e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f6719241-2450-4c57-9569-6470077a1b0e', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:49.276530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-18ebce1b-b229-419b-9410-7cece8102bf1-delete_volume'" acquired by "delete_volume" :: waited 0.230s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:49.341110 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:49.341549 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:49.351041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a980ddd4-6f65-4456-b9a7-a6b500178227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d80424d-fadb-4414-a17c-fc87b37c4294', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.357872 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718a254-d60b-435d-8653-16e5abca5c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:49.425001 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Volume volume-6d80424d-fadb-4414-a17c-fc87b37c4294 (6d80424d-fadb-4414-a17c-fc87b37c4294): created successfully Jun 18 22:31:49.428749 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718a254-d60b-435d-8653-16e5abca5c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:49.434984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Flow 'volume_create_manager' (f7aca8c3-8f37-4367-9945-93df214d52f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:49.438628 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-dbacd13b-b807-45ae-b1c6-289647a7e414 req-adedeed7-c1b1-4465-9e92-89237588b4a2 tempest-VolumesSnapshotTestJSON-1142548725 None] Connection info returned from driver {'name': 'volumes/volume-f6719241-2450-4c57-9569-6470077a1b0e', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f6719241-2450-4c57-9569-6470077a1b0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b41cf0d-99b9-4362-a51a-e45edfdd9306'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:49.459700 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:49.535465 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:49.536242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Volume volume-18ebce1b-b229-419b-9410-7cece8102bf1 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:49.543802 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] deleting rbd volume volume-18ebce1b-b229-419b-9410-7cece8102bf1 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:49.566616 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5cd13e16-4338-4cfe-aaea-f09ed06300e9 tempest-GroupsV314Test-1207482755 None] Created volume successfully. Jun 18 22:31:49.613480 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-dbacd13b-b807-45ae-b1c6-289647a7e414 req-adedeed7-c1b1-4465-9e92-89237588b4a2 tempest-VolumesSnapshotTestJSON-1142548725 None] attachment_update completed successfully. Jun 18 22:31:49.943565 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Created reservations ['f6647380-87b7-42cd-b2d2-f924cdd072c6', '310f1d11-9b54-4a92-813a-da7e2b54fb2e', 'f1562fff-1a75-41bf-958f-4ae506bc15c5', 'ad35ce35-e4b4-4eba-a4da-68adf8a49cdb'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:50.039986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:50.139624 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:50.218292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:50.234512 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Deleted volume successfully. Jun 18 22:31:50.277739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0188286f-532d-467b-88d2-9bea64410272 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-18ebce1b-b229-419b-9410-7cece8102bf1-delete_volume'" released by "delete_volume" :: held 1.001s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:50.440191 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-391fe876-11d6-4b7c-b0cf-c698bbac3b21-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:50.533646 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:50.621876 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:50.623078 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Volume volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:50.636366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] deleting rbd volume volume-391fe876-11d6-4b7c-b0cf-c698bbac3b21 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:50.652173 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a req-964f21ab-6030-466c-b982-6973a5b1aab5 tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:51.076275 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Created reservations ['78b175d5-1e81-4065-bfd8-459e47981faa', '86ae9923-ea76-4799-95cd-fe1d436de58e', '0fcf69dd-cd7c-4c01-bd20-af86ab57b083', 'ccf824b9-a66b-4455-afff-61eddcdb8420'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:51.138679 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=64,cinder:UPDATE=20,cinder:INSERT=14,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:51.161095 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:51.247775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:51.324987 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:51.332495 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Deleted volume successfully. Jun 18 22:31:51.426375 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-cd62f84d-1ba7-4d0e-9760-f4806ba9a4d6 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-391fe876-11d6-4b7c-b0cf-c698bbac3b21-delete_volume'" released by "delete_volume" :: held 0.986s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:51.466989 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:51.608879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] creating snapshot='volume-f9e484c6-7504-4f85-b172-551b6b4f77b0.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:31:51.889624 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] cloning 'volume-6d80424d-fadb-4414-a17c-fc87b37c4294@volume-f9e484c6-7504-4f85-b172-551b6b4f77b0.clone_snap' to 'volume-f9e484c6-7504-4f85-b172-551b6b4f77b0' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:31:52.019273 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-aba020c7-b736-46ee-a1d6-be5789623a04-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:52.046868 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] Volume volume-6d80424d-fadb-4414-a17c-fc87b37c4294 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:52.055658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:52.056589 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:52.081026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:31:52.163450 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:52.226041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:52.226471 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Volume volume-aba020c7-b736-46ee-a1d6-be5789623a04 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:52.232568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] deleting rbd volume volume-aba020c7-b736-46ee-a1d6-be5789623a04 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:52.240686 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a req-964f21ab-6030-466c-b982-6973a5b1aab5 tempest-VolumesBackupsTest-624856523 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.590s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:52.241989 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a req-964f21ab-6030-466c-b982-6973a5b1aab5 tempest-VolumesBackupsTest-624856523 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:52.276098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a req-964f21ab-6030-466c-b982-6973a5b1aab5 tempest-VolumesBackupsTest-624856523 None] Connection info returned from driver {'name': 'volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '17250eff-620d-4301-b2ce-fb6f43c66f10'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:52.316891 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4804aca4-2194-4ef4-826e-43e7c09731cf tempest-GroupsV314Test-1207482755 None] Create group from source-group-2bb8f979-ae26-49fe-9a95-98fd3a68f863 completed successfully. Jun 18 22:31:52.391582 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a req-964f21ab-6030-466c-b982-6973a5b1aab5 tempest-VolumesBackupsTest-624856523 None] attachment_update completed successfully. Jun 18 22:31:52.655284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49353cf9-8f4d-4807-b549-8bd21aaec6ef tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:52.772612 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Created reservations ['09cc4c68-a219-47e0-958d-701df048c7ef', 'f1078e4b-4326-4f1c-9b48-5b70c1e77f70', 'e9c71d21-2d4f-4d4e-8bff-096e3035215b', 'aef9e65a-bd2c-4109-be92-b6ca55e85e03'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:52.784489 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:52.856881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:52.947380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:53.057280 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:53.066272 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Deleted volume successfully. Jun 18 22:31:53.101501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3f626ff7-907a-4959-bb90-280e6d5119a7 tempest-AttachVolumeTestJSON-223712319 None] Lock "b'cinder-aba020c7-b736-46ee-a1d6-be5789623a04-delete_volume'" released by "delete_volume" :: held 1.084s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:31:53.191048 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-49353cf9-8f4d-4807-b549-8bd21aaec6ef tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:31:53.308022 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:31:53.383752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (b4e79751-2aa5-4146-828b-89059bf54684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:53.412665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa99ae5-75bb-4c35-96e4-d791cbf08488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:53.454380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa99ae5-75bb-4c35-96e4-d791cbf08488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:31:53Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e676424b-5606-4481-9caa-e4b865530bef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:31:53Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:53.464263 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c713465-0ed0-49fc-9e01-91570e797a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:53.490848 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c713465-0ed0-49fc-9e01-91570e797a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:53.499048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ca7709-e666-4ad2-9ff9-867d4aba44ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:53.503908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ca7709-e666-4ad2-9ff9-867d4aba44ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'volume_name': 'volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'volume_size': 1, 'snapshot_id': 'e676424b-5606-4481-9caa-e4b865530bef'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:53.517991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8663ac8-050c-4475-aae0-28bfa3059ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:53.523631 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8663ac8-050c-4475-aae0-28bfa3059ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:53.539228 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dccf68-9157-4c4f-9797-24a48c9d857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:53.540558 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Volume 9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'volume_size': 1, 'snapshot_id': 'e676424b-5606-4481-9caa-e4b865530bef'} Jun 18 22:31:53.592544 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] cloning volumes/volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5@snapshot-e676424b-5606-4481-9caa-e4b865530bef to volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0 {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:31:53.598961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:53.746360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:53.991097 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:31:53.991939 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:31:54.141880 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:54.246410 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:54.255303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] deleting rbd volume volume-f9e484c6-7504-4f85-b172-551b6b4f77b0 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:54.264024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Marking volume 9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:31:54.293317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from snapshot e676424b-5606-4481-9caa-e4b865530bef to 9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 18 22:31:54.355207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-de9e53f4-32dc-47bd-902a-4c5a8e4d5e6f tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:54.643425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:31:54.690556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Volume volume-6d80424d-fadb-4414-a17c-fc87b37c4294 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:54.691805 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] deleting parent snapshot volume-f9e484c6-7504-4f85-b172-551b6b4f77b0.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:31:55.710927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dccf68-9157-4c4f-9797-24a48c9d857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'volume_size': 1, 'snapshot_id': 'e676424b-5606-4481-9caa-e4b865530bef'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:55.722089 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d011ac9-06ac-4700-a3aa-08dd3fed7f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:31:55.789134 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Volume volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0 (9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0): created successfully Jun 18 22:31:55.794715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d011ac9-06ac-4700-a3aa-08dd3fed7f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:31:55.801632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (b4e79751-2aa5-4146-828b-89059bf54684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:31:55.825677 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:31:54Z,data_timestamp=2022-06-18T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1024607679',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b20abb62-1047-4cef-914d-a4dd1d8060f4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_id=0e6040aa-afe5-48b7-82e1-848690284862) Jun 18 22:31:55.826483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] continue_backup in rpcapi backup_id b20abb62-1047-4cef-914d-a4dd1d8060f4 {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:31:55.886933 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-c4ea1a0c-45cf-4c75-b658-109f0d9414e0 tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:31:55.935324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Created reservations ['e7730093-a633-4a64-9f37-714cc445823b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:55.944741 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=59,cinder:UPDATE=20,cinder:INSERT=20,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:55.984950 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-de9e53f4-32dc-47bd-902a-4c5a8e4d5e6f tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:31:56.007023 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-234945086 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-234945086, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:31:56.007852 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-234945086 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-234945086, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:31:56.049380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Created reservations ['07e6f52b-5931-4489-831e-06c764714117', '37c4e8a7-f6bf-416d-a26f-c26d8face591', '84bc6a1f-8ce6-45a0-a322-10c6855073a3', 'b52030ab-2160-4883-b3b7-b666ca33cb4f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:56.056901 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:56.250604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:56.341064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:56.437999 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:56.451526 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fe97d1be-9a05-40cb-82b1-6c762c840b31 tempest-GroupsV314Test-1207482755 None] Delete group completed successfully. Jun 18 22:31:56.722837 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=14,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=23 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:56.745867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ca9383cc-9d49-4778-8309-16bb09b5d7a6 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:57.026463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:57.116455 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:31:57.117078 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] Volume volume-6d80424d-fadb-4414-a17c-fc87b37c4294 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:31:57.122799 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] deleting rbd volume volume-6d80424d-fadb-4414-a17c-fc87b37c4294 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:31:57.159773 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-d2e36bd7-604a-4c1f-9439-72f625f6004c tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:31:57.552182 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] Created reservations ['2ef7414c-646d-445c-981f-36b31f681539'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:57.609602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] Created reservations ['fb375341-fbcc-445e-8f0a-de51fb7967dd', '1cad6fe7-6874-4de3-9847-2c46fef9ff74', '2a2c25a0-0376-40ea-aed2-ca86f685577d', 'db83a147-f6b4-4559-becb-9edcb6ac6a0d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:31:57.638308 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.582s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:57.639753 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e6040aa-afe5-48b7-82e1-848690284862', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '0e6040aa-afe5-48b7-82e1-848690284862', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:57.686585 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Initialize volume connection completed successfully. Jun 18 22:31:57.887728 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:57.965636 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:58.035513 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:31:58.041448 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-49eee05b-3de3-4cf8-8f34-d768ae37b790 tempest-GroupsV314Test-1207482755 None] Delete group completed successfully. Jun 18 22:31:58.062877 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ca9383cc-9d49-4778-8309-16bb09b5d7a6 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:31:58.813345 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-d2e36bd7-604a-4c1f-9439-72f625f6004c tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.654s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:31:58.814289 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-d2e36bd7-604a-4c1f-9439-72f625f6004c tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:31:58.853210 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-d2e36bd7-604a-4c1f-9439-72f625f6004c tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '58eabe01-1f4a-4389-986c-a61c8af5dc39'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:31:58.980940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-25db003f-84da-4836-9682-d67abd3303c5 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-db935db5-f12a-46d8-9716-b94516d711a1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:31:58.983096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-25db003f-84da-4836-9682-d67abd3303c5 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:31:59.162517 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 req-d2e36bd7-604a-4c1f-9439-72f625f6004c tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:31:59.894248 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Terminate volume connection completed successfully. Jun 18 22:31:59.917233 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6755f34-6e05-4cb9-b931-5dee5b79a462 tempest-VolumesBackupsTest-624856523 None] Remove volume export completed successfully. Jun 18 22:32:02.471435 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-2f9c6811-0d5a-402f-b013-0dc434c3f33a req-d2973aca-993b-4342-ac86-0fadda0b4dab tempest-VolumesBackupsTest-624856523 None] Terminate volume connection completed successfully. Jun 18 22:32:02.472571 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-2f9c6811-0d5a-402f-b013-0dc434c3f33a req-d2973aca-993b-4342-ac86-0fadda0b4dab tempest-VolumesBackupsTest-624856523 None] Deleting attachment 17250eff-620d-4301-b2ce-fb6f43c66f10. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:32:04.705545 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6b951ec-2fa2-4501-98db-b1bfa1bb320c tempest-GroupsV320Test-1628554029 None] Group tempest-GroupsV320Test-Group-1427781607: creating Jun 18 22:32:04.743478 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6b951ec-2fa2-4501-98db-b1bfa1bb320c tempest-GroupsV320Test-1628554029 None] Group tempest-GroupsV320Test-Group-1427781607: created successfully Jun 18 22:32:04.763944 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c6b951ec-2fa2-4501-98db-b1bfa1bb320c tempest-GroupsV320Test-1628554029 None] Create group completed successfully. Jun 18 22:32:06.562675 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=12,cinder:UPDATE=25,cinder:SELECT=63 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:06.601870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9df37c72-0c88-441d-82a2-e348d21031d8 tempest-GroupsV320Test-1628554029 None] Created reservations ['4fba12f0-46ce-44c5-89c5-d2d581e3b22e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:06.665789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9df37c72-0c88-441d-82a2-e348d21031d8 tempest-GroupsV320Test-1628554029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:06.713374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9df37c72-0c88-441d-82a2-e348d21031d8 tempest-GroupsV320Test-1628554029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:06.766523 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-9df37c72-0c88-441d-82a2-e348d21031d8 tempest-GroupsV320Test-1628554029 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:06.772435 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9df37c72-0c88-441d-82a2-e348d21031d8 tempest-GroupsV320Test-1628554029 None] Delete group completed successfully. Jun 18 22:32:07.613675 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-0e6040aa-afe5-48b7-82e1-848690284862-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:07.719440 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:08.762677 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Volume volume-0e6040aa-afe5-48b7-82e1-848690284862 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:32:08.796069 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] deleting rbd volume volume-0e6040aa-afe5-48b7-82e1-848690284862 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:09.186274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Created reservations ['323cdf02-a9ce-4d0e-8fcb-504d38344534', '435073c4-daf2-4ad1-a3a6-a8133f0eeff9', 'ed189419-16a1-4683-957b-2c826d77ee01', '5efb7c77-db08-4808-bb0f-cd4ebc36165d'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:09.252052 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:UPDATE=23,cinder:INSERT=11,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:09.280877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:09.346986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:09.403894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:09.410315 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Deleted volume successfully. Jun 18 22:32:09.429339 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-6195ce50-9710-4dd6-8d33-68063c4481a0 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-0e6040aa-afe5-48b7-82e1-848690284862-delete_volume'" released by "delete_volume" :: held 1.819s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:10.763737 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:32:10.787364 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (9e36647f-ba99-4c89-b006-3fac190326a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:10.796046 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3f8113-421d-46ce-91c8-9caaba39bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:10.816278 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3f8113-421d-46ce-91c8-9caaba39bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-103236386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e19dbd28-395a-445b-b3fc-c301aa82e185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:32:11Z,use_quota=True,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:10.825195 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76273fba-8d56-4df8-bf10-8139e165817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:10.833705 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76273fba-8d56-4df8-bf10-8139e165817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:10.839720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c534b49-78f5-44f0-af5b-b74783f65490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:11.074509 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c534b49-78f5-44f0-af5b-b74783f65490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e19dbd28-395a-445b-b3fc-c301aa82e185', 'volume_name': 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:11.087278 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1527a16-910e-41b8-b369-284adede28a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:11.103570 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1527a16-910e-41b8-b369-284adede28a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:11.113807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141f28c6-6025-4a6d-940f-17a258b360cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:11.115117 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Volume e19dbd28-395a-445b-b3fc-c301aa82e185: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:32:11.116709 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Cloning e19dbd28-395a-445b-b3fc-c301aa82e185 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:32:11.153407 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:11.174071 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 32, 11, 160475)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:32:11.174785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:32:11.176551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:32:11.182993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:11.187041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:32:11.202226 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 32, 11, 198652)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:32:11.203744 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:32:11.204944 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:32:11.258455 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:11.453047 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] creating snapshot='volume-e19dbd28-395a-445b-b3fc-c301aa82e185.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:32:11.786357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-e19dbd28-395a-445b-b3fc-c301aa82e185.clone_snap' to 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:32:11.849470 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-24f09a00-9139-4997-bdff-484923f3beef tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:32:11.852668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-24f09a00-9139-4997-bdff-484923f3beef tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment 58eabe01-1f4a-4389-986c-a61c8af5dc39. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:32:12.021674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:32:12.024988 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:32:12.025980 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:32:12.074610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:32:12.076598 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Marking volume e19dbd28-395a-445b-b3fc-c301aa82e185 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:32:12.095043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to e19dbd28-395a-445b-b3fc-c301aa82e185. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:32:12.098173 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Creating volume glance metadata for volume e19dbd28-395a-445b-b3fc-c301aa82e185 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:32:12.162685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0-delete_volume'" acquired by "delete_volume" :: waited 0.052s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:12.290790 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:12.449978 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:32:12.460891 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:12.510764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141f28c6-6025-4a6d-940f-17a258b360cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:12.520050 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f46934-507a-4bda-aeec-a2cfd378d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:12.533745 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Volume volume-e19dbd28-395a-445b-b3fc-c301aa82e185 (e19dbd28-395a-445b-b3fc-c301aa82e185): created successfully Jun 18 22:32:12.539775 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f46934-507a-4bda-aeec-a2cfd378d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:12.548105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (9e36647f-ba99-4c89-b006-3fac190326a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:12.600574 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3dc99627-d19f-4a6d-a5df-5661a3afe3d9 tempest-VolumesBackupsTest-624856523 None] Created volume successfully. Jun 18 22:32:13.064349 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['605e6acf-22a5-458b-a9a7-2c88e17f243c', 'c49fbad9-0f1a-4cc1-97d2-54932421c398', '9a2c0006-544c-45c5-802c-f32996a13690', '433d2bd8-e000-4316-9e76-312301d21c77'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:13.194552 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:13.248009 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:13.314967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:13.325197 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:32:13.347598 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:32:13Z,data_timestamp=2022-06-18T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-866247733',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=1a444022-9454-4029-a324-97aed3646e0c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_id=e19dbd28-395a-445b-b3fc-c301aa82e185) Jun 18 22:32:13.348348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] continue_backup in rpcapi backup_id 1a444022-9454-4029-a324-97aed3646e0c {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:32:13.396914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-1fa3227d-5822-42c4-91f6-9aaf1311baee req-4f15b107-ae03-4ebd-b390-c33628d1ca8f tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-9d6d36c5-c5c5-43fd-ae3f-f8dec971fcd0-delete_volume'" released by "delete_volume" :: held 1.234s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:13.652362 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:32:14.374192 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2e33aec0-2523-4066-b04f-b213e8ddba6f tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-e676424b-5606-4481-9caa-e4b865530bef-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.041s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:14.376706 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2e33aec0-2523-4066-b04f-b213e8ddba6f tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:14.988486 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.336s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:32:14.989248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e19dbd28-395a-445b-b3fc-c301aa82e185', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'e19dbd28-395a-445b-b3fc-c301aa82e185', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:32:15.012859 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Initialize volume connection completed successfully. Jun 18 22:32:22.087969 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Terminate volume connection completed successfully. Jun 18 22:32:22.129984 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b0d9615a-0420-44d0-a09a-45bd3e71d345 tempest-VolumesBackupsTest-624856523 None] Remove volume export completed successfully. Jun 18 22:32:23.400015 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=56,cinder:UPDATE=29,cinder:INSERT=13,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:23.448844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:32:23.508730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (7c9f1b1d-1029-4c54-9222-0d225eeb342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:23.531126 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6565354-d31c-4977-bc6f-289bc2258aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.565607 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6565354-d31c-4977-bc6f-289bc2258aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:32:23Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_1a444022-9454-4029-a324-97aed3646e0c',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ffe351c-051c-4b4c-9986-4301b09c4982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b4d0121cf24c619d4ad0f5af414dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:32:23Z,use_quota=True,user_id='a4b5f6d69d1e4804923d47dd4d71d443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.572480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73357654-d574-47fe-89e6-45d88c9f8784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.586000 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73357654-d574-47fe-89e6-45d88c9f8784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.591923 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc5a740-42d2-4e0e-b6ee-86ffbba817cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.596802 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc5a740-42d2-4e0e-b6ee-86ffbba817cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffe351c-051c-4b4c-9986-4301b09c4982', 'volume_name': 'volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.603336 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae868bde-b9ae-4c2b-8925-c579bb4d157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.607954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae868bde-b9ae-4c2b-8925-c579bb4d157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.613940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fc783d-bb2c-4b03-bb45-73794ff7ed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.615331 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Volume 7ffe351c-051c-4b4c-9986-4301b09c4982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'volume_size': 1} Jun 18 22:32:23.616302 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] creating volume 'volume-7ffe351c-051c-4b4c-9986-4301b09c4982' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:32:23.617366 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:23.718888 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:32:23.720166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:32:23.724810 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fc783d-bb2c-4b03-bb45-73794ff7ed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.732776 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dadd2e4-9adc-4a4d-b653-6b6a187ee236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:23.759822 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Volume volume-7ffe351c-051c-4b4c-9986-4301b09c4982 (7ffe351c-051c-4b4c-9986-4301b09c4982): created successfully Jun 18 22:32:23.765217 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dadd2e4-9adc-4a4d-b653-6b6a187ee236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:23.805731 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Flow 'volume_create_manager' (7c9f1b1d-1029-4c54-9222-0d225eeb342a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:23.837639 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Created volume successfully. Jun 18 22:32:24.671189 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:32:26.050982 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.381s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:32:26.051866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7ffe351c-051c-4b4c-9986-4301b09c4982', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '7ffe351c-051c-4b4c-9986-4301b09c4982', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:32:26.085366 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Initialize volume connection completed successfully. Jun 18 22:32:29.524169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-25db003f-84da-4836-9682-d67abd3303c5 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['586f2fd7-32d8-4321-bf9f-a48b5ec8b6fc', '1bf2c832-9925-4feb-af13-2941a69664a6', 'd3b363a1-ab2b-4bf0-9b2f-cdef87036f8a', '95fcb967-0f2e-4983-8b67-28c7f0c628cc'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:29.659812 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-25db003f-84da-4836-9682-d67abd3303c5 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:32:29.688550 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-25db003f-84da-4836-9682-d67abd3303c5 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-db935db5-f12a-46d8-9716-b94516d711a1-delete_snapshot'" released by "delete_snapshot" :: held 30.708s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:30.047012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a6811b35-40f6-4a61-9429-a4e459ad2ff6 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-f80db6d1-9b25-4dd2-88d1-610504af0b9c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:30.050983 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a6811b35-40f6-4a61-9429-a4e459ad2ff6 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:32.660507 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Terminate volume connection completed successfully. Jun 18 22:32:32.711144 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-02c21caf-e6c1-4121-b808-a87c44ddc01b tempest-VolumesBackupsTest-624856523 None] Remove volume export completed successfully. Jun 18 22:32:33.306845 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-7ffe351c-051c-4b4c-9986-4301b09c4982-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:33.395944 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:34.006009 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Volume volume-7ffe351c-051c-4b4c-9986-4301b09c4982 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:32:34.062065 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] deleting rbd volume volume-7ffe351c-051c-4b4c-9986-4301b09c4982 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:35.180787 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Created reservations ['df1bae1a-2253-42db-a33c-c90c817de94a', '1b9a7bc5-04cc-4118-81ee-6f9cecfefc3f', '66ff7041-3981-4c86-8226-8119184c52cf', '1e0919fb-2fd2-4d5b-94c0-455a26e4fc59'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:35.249827 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=68,cinder:UPDATE=21,cinder:INSERT=10,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:35.288010 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:35.362622 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:35.454093 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:35.459156 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Deleted volume successfully. Jun 18 22:32:35.481623 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-01a6ae20-cabe-4ebf-aa62-aba7f6caafee tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-7ffe351c-051c-4b4c-9986-4301b09c4982-delete_volume'" released by "delete_volume" :: held 2.174s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:37.920837 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-e19dbd28-395a-445b-b3fc-c301aa82e185-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:38.013669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:39.155104 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] deleting rbd volume volume-e19dbd28-395a-445b-b3fc-c301aa82e185 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:39.769556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:32:39.848989 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] deleting parent snapshot volume-e19dbd28-395a-445b-b3fc-c301aa82e185.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:32:40.872239 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] Created reservations ['91209d0c-5b9d-496c-84de-b21bdd601133', '31019579-84ba-47c1-941b-b8e49c93766d', 'fc98499f-ca3b-4f28-a9f5-ba758b3bf1e4', '22927359-e338-45b8-b7a1-16915513dafa'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:40.950927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:41.002983 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:41.064230 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:41.068649 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] Deleted volume successfully. Jun 18 22:32:41.090866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7767b7bc-02cd-4b13-a42f-fc58384b8a85 tempest-VolumesBackupsTest-624856523 None] Lock "b'cinder-e19dbd28-395a-445b-b3fc-c301aa82e185-delete_volume'" released by "delete_volume" :: held 3.172s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:44.740245 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-2e33aec0-2523-4066-b04f-b213e8ddba6f tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['dc847061-71f7-44cc-b15f-86572ea30ef2', '613451cb-7d28-44d5-bac2-8869de8a46d2', '82ef3f3d-a5d8-4d06-b8db-bb0ac67bea23', '77d09542-a273-4c36-869c-5d1e11b2435a'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:44.860015 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-2e33aec0-2523-4066-b04f-b213e8ddba6f tempest-TestVolumeBootPattern-2084543740 None] Delete snapshot completed successfully. Jun 18 22:32:44.867154 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2e33aec0-2523-4066-b04f-b213e8ddba6f tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-e676424b-5606-4481-9caa-e4b865530bef-delete_snapshot'" released by "delete_snapshot" :: held 30.493s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:46.252897 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:32:46.282688 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Flow 'volume_create_manager' (1b81aff0-b978-4fca-bea3-ba05c6df35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:46.290915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50d6b51-5b23-42e0-aa8c-e989b1a26138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.307365 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50d6b51-5b23-42e0-aa8c-e989b1a26138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1438247626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ee789f989a4382bac7b1a5ed79d4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:32:46Z,use_quota=True,user_id='fb7707ec6a664b328adfa6efc791f6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.313026 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b366930-3655-4533-8abb-a8aab4b435da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.318657 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b366930-3655-4533-8abb-a8aab4b435da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.323574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2375cf4a-7108-4426-89ca-d8ea6574d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.328710 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2375cf4a-7108-4426-89ca-d8ea6574d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'volume_name': 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.333958 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c10369-0e2b-46a8-a971-993e1ed60071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.338151 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c10369-0e2b-46a8-a971-993e1ed60071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.343948 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67809498-1362-4b44-9323-c74a16b53a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.345071 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Volume f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'volume_size': 1} Jun 18 22:32:46.345457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] creating volume 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:32:46.346554 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:46.425784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:32:46.426452 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:32:46.430236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67809498-1362-4b44-9323-c74a16b53a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.435386 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756555bd-8191-4c1d-9065-153ef601f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:46.447597 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Volume volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa (f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa): created successfully Jun 18 22:32:46.451738 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756555bd-8191-4c1d-9065-153ef601f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:46.458965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Flow 'volume_create_manager' (1b81aff0-b978-4fca-bea3-ba05c6df35c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:46.472375 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0d21b56e-8b99-490e-8bc9-89686394f3b3 tempest-VolumesBackupsV39Test-288082446 None] Created volume successfully. Jun 18 22:32:47.365861 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:32:47.366618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:47.423950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:47.507881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:47.599252 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:32:47Z,data_timestamp=2022-06-18T22:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1981967244',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=95809608-10bb-4891-8b8c-6e85157a285c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c5ee789f989a4382bac7b1a5ed79d4d3',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='fb7707ec6a664b328adfa6efc791f6e4',volume_id=f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa) Jun 18 22:32:47.600501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] continue_backup in rpcapi backup_id 95809608-10bb-4891-8b8c-6e85157a285c {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:32:47.791651 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:32:48.261282 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-6272e597-a4dc-4da4-bd50-12702dc653bb tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:32:48.261772 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-6272e597-a4dc-4da4-bd50-12702dc653bb tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment c2b27c22-9715-44d2-95ec-f2f33c7665e3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:32:48.508984 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-2f117025-1ed5-4e5a-a29d-470d49e0c8c5-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:48.562213 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:48.608853 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:48.738780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:32:48.750390 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:49.059103 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.268s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:32:49.060000 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:32:49.081494 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Initialize volume connection completed successfully. Jun 18 22:32:49.122022 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:32:49.164164 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] deleting parent snapshot volume-2f117025-1ed5-4e5a-a29d-470d49e0c8c5.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:32:49.793858 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['81398e0e-e21b-439f-941e-81297cd446df', '1799a129-0f05-423f-9442-1887d2ecc07c', '7613c23a-aa57-4b0e-a627-f078c88b6eca', 'a0ccf150-d7b1-4e3c-8427-02693e5f2fa3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:49.902674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:50.001637 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:50.064426 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:50.077577 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:32:50.105296 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-3d3ab158-48c0-49d0-a535-f7231e04ec11 req-b8e44f3e-9cb5-47e3-aaa4-54b6c58b2db6 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-2f117025-1ed5-4e5a-a29d-470d49e0c8c5-delete_volume'" released by "delete_volume" :: held 1.596s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:51.146110 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Terminate volume connection completed successfully. Jun 18 22:32:51.175606 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4eef794b-7060-46f7-8693-f4c0f9327759 tempest-VolumesBackupsV39Test-288082446 None] Remove volume export completed successfully. Jun 18 22:32:54.187442 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Lock "b'cinder-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:54.207328 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=64,cinder:INSERT=8,cinder:UPDATE=28 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:54.259520 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:54.747277 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Volume volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:32:54.776676 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] deleting rbd volume volume-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:32:55.243624 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Created reservations ['3e31cfcb-6ec9-4dc9-a711-11b2f404633d', '20ea5ac7-e87c-47e1-b347-56012466e7e0', '1f048f5d-0f93-40c7-a121-58ebdb47e785', 'a8105c40-b36c-44f2-88d7-6232aa70aeca'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:32:55.343569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:55.414545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:55.496453 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:32:55.500522 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Deleted volume successfully. Jun 18 22:32:55.520445 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-76286730-af26-42fc-a4bc-19c4a521855e tempest-VolumesBackupsV39Test-288082446 None] Lock "b'cinder-f1b8d7ef-2b5d-425a-9510-9e9c811f8bfa-delete_volume'" released by "delete_volume" :: held 1.333s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:55.663454 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:32:55.687318 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (c6a2f701-e90c-488a-adcd-e1218a7b5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:55.695542 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30691263-79fe-44a5-b238-800d331a5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:55.717324 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30691263-79fe-44a5-b238-800d331a5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-552133701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92eb6127-5f06-4961-a0f5-c7fb19e61c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:32:56Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:55.723613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e48e802-cb6b-42b3-afa2-75688d796590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:55.728287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e48e802-cb6b-42b3-afa2-75688d796590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:55.733912 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5589e280-936c-4e90-9344-57a23d347418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:55.865071 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5589e280-936c-4e90-9344-57a23d347418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'volume_name': 'volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:55.871774 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ec78a5-462d-4b0e-808c-ce64d5069919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:55.876605 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ec78a5-462d-4b0e-808c-ce64d5069919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:55.882701 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1963ed23-bb8f-4c2b-b9f1-8b8b55522d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:55.884652 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Volume 92eb6127-5f06-4961-a0f5-c7fb19e61c04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 22:32:55.885943 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Cloning 92eb6127-5f06-4961-a0f5-c7fb19e61c04 from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 22:32:55.898132 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:32:55.912355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 32, 55, 902874)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:32:55.913171 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:32:55.913510 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 22:32:55.919911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:32:55.921574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 22:32:55.933254 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 22, 32, 55, 927318)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 22:32:55.934001 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 22:32:55.934882 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 22:32:55.947780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:32:56.019213 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] creating snapshot='volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 22:32:56.770560 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04.clone_snap' to 'volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 22:32:56.958747 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:32:56.960339 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:32:56.960879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:32:56.983039 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 22:32:56.983588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Marking volume 92eb6127-5f06-4961-a0f5-c7fb19e61c04 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:32:56.994778 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to 92eb6127-5f06-4961-a0f5-c7fb19e61c04. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 22:32:56.995806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Creating volume glance metadata for volume 92eb6127-5f06-4961-a0f5-c7fb19e61c04 backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 22:32:57.072113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1963ed23-bb8f-4c2b-b9f1-8b8b55522d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:57.076933 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e076c13b-c3fd-480f-aaa7-b43a0486b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:32:57.088128 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Volume volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04 (92eb6127-5f06-4961-a0f5-c7fb19e61c04): created successfully Jun 18 22:32:57.095968 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e076c13b-c3fd-480f-aaa7-b43a0486b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:32:57.102290 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (c6a2f701-e90c-488a-adcd-e1218a7b5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:32:57.113550 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0628b29f-a284-4a3c-a59f-3bc88ef37345 tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:33:00.494568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-a6811b35-40f6-4a61-9429-a4e459ad2ff6 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['6f9b9e69-1a59-4123-b85e-a15cdb4aa1aa', '3994a595-ad67-4b13-8115-288e4977c47c', '86b6fe32-52cc-427a-b3a3-4ed3c19cdde0', 'b495fef4-a825-4571-b378-55993d87c380'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:33:00.570837 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a6811b35-40f6-4a61-9429-a4e459ad2ff6 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:33:00.583818 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a6811b35-40f6-4a61-9429-a4e459ad2ff6 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-f80db6d1-9b25-4dd2-88d1-610504af0b9c-delete_snapshot'" released by "delete_snapshot" :: held 30.537s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:33:01.080443 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed req-0c580fe1-a4a7-4d2b-bc6e-6558baa8d547 tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:33:01.736810 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a5359e7e-e433-461a-969d-797b38b04946 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-6cbfb497-ccfe-4214-9976-1b7bcbded5c7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:33:01.742257 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-a5359e7e-e433-461a-969d-797b38b04946 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:02.508687 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed req-0c580fe1-a4a7-4d2b-bc6e-6558baa8d547 tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.428s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:33:02.509693 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed req-0c580fe1-a4a7-4d2b-bc6e-6558baa8d547 tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:33:02.558310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed req-0c580fe1-a4a7-4d2b-bc6e-6558baa8d547 tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a4dad367-b10a-4333-ab46-f01996b68a53'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:33:02.633573 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed req-0c580fe1-a4a7-4d2b-bc6e-6558baa8d547 tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:33:20.799225 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=53,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:30.816390 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:32.176986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-a5359e7e-e433-461a-969d-797b38b04946 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['f66ae5ce-cee5-4759-98f0-c752f723c4dc', '717a71b9-eb62-4067-9ace-7f43b0cbd75f', '56efc4a9-f59c-4a7e-a41a-c2e22f5d58c1', '487d9c31-cd2b-4df1-9f7d-0773ffc63778'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:33:32.287233 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-a5359e7e-e433-461a-969d-797b38b04946 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:33:32.297838 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-a5359e7e-e433-461a-969d-797b38b04946 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-6cbfb497-ccfe-4214-9976-1b7bcbded5c7-delete_snapshot'" released by "delete_snapshot" :: held 30.561s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:33:34.601760 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-a384995a-4930-47a3-ac05-1b3600214966 req-0d5473fa-4fc3-4743-b56d-a6fa1c8b43ee tempest-VolumesSnapshotTestJSON-1142548725 None] Terminate volume connection completed successfully. Jun 18 22:33:34.602894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-a384995a-4930-47a3-ac05-1b3600214966 req-0d5473fa-4fc3-4743-b56d-a6fa1c8b43ee tempest-VolumesSnapshotTestJSON-1142548725 None] Deleting attachment 0b41cf0d-99b9-4362-a51a-e45edfdd9306. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:33:39.819604 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c74a4d1b-396a-4113-a440-9e3fe8a31365 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:40.901538 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c74a4d1b-396a-4113-a440-9e3fe8a31365 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:33:42.193090 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-08cd86d6-2bb5-4d77-9a07-62d727aa9b9d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-9c7360eb-f4b9-41dc-b7ac-15caabb8c801-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:33:42.198188 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-08cd86d6-2bb5-4d77-9a07-62d727aa9b9d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:42.932836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-08cd86d6-2bb5-4d77-9a07-62d727aa9b9d tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['31fab67d-42a0-48c9-a17f-c24b37ee0fc4', '81bb241d-592b-4041-9927-951b00c5feed', '3cae66ca-3c74-4c09-801b-63db10558ae2', 'b9ce8a61-5746-43e3-9d9b-e42b6fcaf6ed'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:33:43.036334 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-08cd86d6-2bb5-4d77-9a07-62d727aa9b9d tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:33:43.044105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-08cd86d6-2bb5-4d77-9a07-62d727aa9b9d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-9c7360eb-f4b9-41dc-b7ac-15caabb8c801-delete_snapshot'" released by "delete_snapshot" :: held 0.851s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:33:43.749965 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6584e1ce-6910-40eb-bf1c-7b7e70422ffb tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:44.977168 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6584e1ce-6910-40eb-bf1c-7b7e70422ffb tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:33:47.364882 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:33:47.366415 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:47.414468 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:33:47.498556 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:33:54.981134 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=15 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:00.815384 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=39,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:01.622705 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-d5188449-0efb-49ad-a564-220154917bd7 req-1060af83-7c27-40b7-a7d0-3aa5fffc890c tempest-VolumesSnapshotTestJSON-1142548725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:34:02.939907 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-d5188449-0efb-49ad-a564-220154917bd7 req-1060af83-7c27-40b7-a7d0-3aa5fffc890c tempest-VolumesSnapshotTestJSON-1142548725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.317s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:34:02.941198 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-d5188449-0efb-49ad-a564-220154917bd7 req-1060af83-7c27-40b7-a7d0-3aa5fffc890c tempest-VolumesSnapshotTestJSON-1142548725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:34:02.972530 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-d5188449-0efb-49ad-a564-220154917bd7 req-1060af83-7c27-40b7-a7d0-3aa5fffc890c tempest-VolumesSnapshotTestJSON-1142548725 None] Connection info returned from driver {'name': 'volumes/volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0bb96dac-d22f-48b7-8475-af7c0c8e42d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1bcfbb77-5715-42b1-a947-61bbcc622ba5'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:34:03.063820 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-d5188449-0efb-49ad-a564-220154917bd7 req-1060af83-7c27-40b7-a7d0-3aa5fffc890c tempest-VolumesSnapshotTestJSON-1142548725 None] attachment_update completed successfully. Jun 18 22:34:05.191193 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ca74e094-ac56-4c51-b914-1b66d98ad9cd tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:05.955243 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ca74e094-ac56-4c51-b914-1b66d98ad9cd tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:34:06.648960 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dbbdf349-1efb-49b4-8ec6-d4c640a86167 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:06.946902 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-dbbdf349-1efb-49b4-8ec6-d4c640a86167 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:34:07.777024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-45af7f1c-b3f9-44f2-a1a4-df5872148e51 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-3b460011-9162-4c11-a882-5a4bb2698473-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.032s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:34:07.778578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45af7f1c-b3f9-44f2-a1a4-df5872148e51 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:20.832202 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=30,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:27.151986 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-50e11321-46b8-4593-a509-8e59b7f04b5b tempest-GroupSnapshotsV319Test-518868300 None] Group tempest-GroupSnapshotsV319Test-Group-2070256349: creating Jun 18 22:34:27.171907 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-50e11321-46b8-4593-a509-8e59b7f04b5b tempest-GroupSnapshotsV319Test-518868300 None] Group tempest-GroupSnapshotsV319Test-Group-2070256349: created successfully Jun 18 22:34:27.183610 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-50e11321-46b8-4593-a509-8e59b7f04b5b tempest-GroupSnapshotsV319Test-518868300 None] Create group completed successfully. Jun 18 22:34:28.642631 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:34:28.663586 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Flow 'volume_create_manager' (5cf2d2cc-87ea-4054-9525-55e61df92e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:28.670115 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a09e2d-e42d-440e-b872-56cfc0c85b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.690285 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a09e2d-e42d-440e-b872-56cfc0c85b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-810135087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=949f3366-b772-46f5-a62d-ceb1b6c2941f,host='ncdv-master-1@ceph#ceph',id=fb295b1e-9644-4d54-9391-be033d1f2593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c43e2eea79d4ef3a1ca3a4c315923c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:34:29Z,use_quota=True,user_id='2bd9adf893c243bbacdb6b0b16f08173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f526ddce-be43-4af8-a26a-0e28700a6193),volume_type_id=f526ddce-be43-4af8-a26a-0e28700a6193)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.696518 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff5414-3cb2-4a31-915e-37f881cf2795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.701070 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff5414-3cb2-4a31-915e-37f881cf2795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.706924 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43b6235-95f6-445c-9dc5-9af964f88f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.711459 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43b6235-95f6-445c-9dc5-9af964f88f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb295b1e-9644-4d54-9391-be033d1f2593', 'volume_name': 'volume-fb295b1e-9644-4d54-9391-be033d1f2593', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.716400 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61ff7ca-30b8-4a9b-9e3f-478b6df84a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.720523 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61ff7ca-30b8-4a9b-9e3f-478b6df84a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.726241 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2de0a91-ca46-4f73-8b42-fe19802f24f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.727619 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Volume fb295b1e-9644-4d54-9391-be033d1f2593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb295b1e-9644-4d54-9391-be033d1f2593', 'volume_size': 1} Jun 18 22:34:28.728258 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] creating volume 'volume-fb295b1e-9644-4d54-9391-be033d1f2593' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:34:28.729171 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:28.793828 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] extra_specs: {} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:34:28.794432 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] extra_specs: {} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:34:28.798266 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2de0a91-ca46-4f73-8b42-fe19802f24f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb295b1e-9644-4d54-9391-be033d1f2593', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.805150 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f699f86e-c8f2-4029-b240-fc905747c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:28.816124 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Volume volume-fb295b1e-9644-4d54-9391-be033d1f2593 (fb295b1e-9644-4d54-9391-be033d1f2593): created successfully Jun 18 22:34:28.819927 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f699f86e-c8f2-4029-b240-fc905747c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:28.825715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Flow 'volume_create_manager' (5cf2d2cc-87ea-4054-9525-55e61df92e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:28.835940 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-271ed93f-964d-4a93-a8a9-ae4a2b188f29 tempest-GroupSnapshotsV319Test-518868300 None] Created volume successfully. Jun 18 22:34:29.911750 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6dd8bedb-3004-46a4-8a7a-524df49d50e0 tempest-GroupSnapshotsV319Test-518868300 None] GroupSnapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: creating. Jun 18 22:34:29.935479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6dd8bedb-3004-46a4-8a7a-524df49d50e0 tempest-GroupSnapshotsV319Test-518868300 None] Group snapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: creating. {{(pid=123873) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 18 22:34:29.960962 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6dd8bedb-3004-46a4-8a7a-524df49d50e0 tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:30.923713 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=39,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:30.981659 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6dd8bedb-3004-46a4-8a7a-524df49d50e0 tempest-GroupSnapshotsV319Test-518868300 None] group_snapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: created successfully Jun 18 22:34:31.435938 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] group_snapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: deleting Jun 18 22:34:31.453688 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] group_snapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: deleting {{(pid=123873) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 18 22:34:31.484260 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:31.970243 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-612838395 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-612838395, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:34:31.971828 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-612838395 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-612838395, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:34:31.988363 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] Created reservations ['4c405fed-481e-423c-ba71-91856ce84218', '4befcaee-63c7-41a1-8444-6b8808080331', 'c33eed26-09ec-450a-bf37-1503530b8e47', '89c1cc67-af2d-4faf-9ad6-f93a13b4827b'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:32.045331 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c79fae11-70e9-4765-b830-467717b92e3d tempest-GroupSnapshotsV319Test-518868300 None] group_snapshot a52ca1e5-3437-44cf-8a7c-1cc8d7595665: deleted successfully Jun 18 22:34:32.933877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:33.021966 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:34:33.022581 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Volume volume-fb295b1e-9644-4d54-9391-be033d1f2593 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:34:33.033491 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] deleting rbd volume volume-fb295b1e-9644-4d54-9391-be033d1f2593 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:34:33.290826 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Created reservations ['eed8f78a-3cb9-4953-9a6b-257b69dedc38'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:33.317181 ncdv-master-1 cinder-volume[123873]: WARNING cinder.quota [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-612838395 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-612838395, it is now deprecated. Please use the default quota class for default quota. Jun 18 22:34:33.340558 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Created reservations ['82f376f0-e99b-4ee5-ab12-9a5a965e01e6', '6827099a-6413-4fec-bb14-0a22c8716202', 'f61a1995-b906-4e51-b59a-15df8856221f', '58935a96-017d-458c-9bc9-cc4611f57100'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:33.447614 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:33.491724 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:33.537360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:34:33.542804 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-efc86169-9031-4dc4-baa6-504ee50a82e7 tempest-GroupSnapshotsV319Test-518868300 None] Delete group completed successfully. Jun 18 22:34:38.101967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-45af7f1c-b3f9-44f2-a1a4-df5872148e51 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['0f2fe52d-b4c5-4a90-83d2-808dd56e8018', 'a0836119-7cb7-4eda-a9a2-7f6e8a5acb23', '8cef92cd-5da3-4120-95b8-781c55d2efa2', '83cff975-52f1-41b0-a01d-a635176ac75f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:38.172683 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-45af7f1c-b3f9-44f2-a1a4-df5872148e51 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:34:38.190439 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-45af7f1c-b3f9-44f2-a1a4-df5872148e51 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-3b460011-9162-4c11-a882-5a4bb2698473-delete_snapshot'" released by "delete_snapshot" :: held 30.413s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:34:38.197326 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:38.205961 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:34:38.226123 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (80766186-b116-4d0d-abd0-273db4a25a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:38.233389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f61efc-3451-4af7-a4e7-55068c2b726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.254155 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f61efc-3451-4af7-a4e7-55068c2b726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1116150393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=270411b1-acf4-4bd6-922a-7af233b7ff93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877d3d3b2044a089edd8b07f303d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:34:38Z,use_quota=True,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.260028 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bb9d49-a1f7-4b14-a193-a76882114d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.264189 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bb9d49-a1f7-4b14-a193-a76882114d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.272730 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfefcb9-8b64-4e49-9400-8110f36ba974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.281714 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfefcb9-8b64-4e49-9400-8110f36ba974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270411b1-acf4-4bd6-922a-7af233b7ff93', 'volume_name': 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.289661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7948b102-d984-4f05-baa5-bea750353a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.294687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7948b102-d984-4f05-baa5-bea750353a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.299338 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f868f0d-fd7f-4ab5-85f3-68afeba7562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.300444 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Volume 270411b1-acf4-4bd6-922a-7af233b7ff93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'volume_size': 1} Jun 18 22:34:38.301081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] creating volume 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:34:38.302105 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:38.366397 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:34:38.366863 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:34:38.373132 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f868f0d-fd7f-4ab5-85f3-68afeba7562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.378274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a34fc16-877d-4226-b18d-a0a41068f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:38.397711 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-270411b1-acf4-4bd6-922a-7af233b7ff93 (270411b1-acf4-4bd6-922a-7af233b7ff93): created successfully Jun 18 22:34:38.401579 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a34fc16-877d-4226-b18d-a0a41068f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:38.407242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (80766186-b116-4d0d-abd0-273db4a25a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:38.417281 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6cd3de7c-b5c1-45a0-8329-5e21568ff4d9 tempest-VolumesBackupsAdminTest-343096894 None] Created volume successfully. Jun 18 22:34:39.232121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7fdfe4f9-d929-4021-8c74-18f5d81cc761 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-d4111b84-32e4-459c-aee2-cb15367e7ae0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:34:39.234716 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7fdfe4f9-d929-4021-8c74-18f5d81cc761 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:39.525272 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:34:39Z,data_timestamp=2022-06-18T22:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1837978769',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=dbb6a402-6bbb-4314-8339-efc34c5209b7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cf877d3d3b2044a089edd8b07f303d54',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_id=270411b1-acf4-4bd6-922a-7af233b7ff93) Jun 18 22:34:39.526145 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] continue_backup in rpcapi backup_id dbb6a402-6bbb-4314-8339-efc34c5209b7 {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:34:39.683958 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:34:40.522434 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.838s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:34:40.524335 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-270411b1-acf4-4bd6-922a-7af233b7ff93', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '270411b1-acf4-4bd6-922a-7af233b7ff93', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:34:40.544086 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Initialize volume connection completed successfully. Jun 18 22:34:42.222906 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Terminate volume connection completed successfully. Jun 18 22:34:42.243109 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-62910d72-3e9b-428d-9f03-8cbb6f237407 tempest-VolumesBackupsAdminTest-343096894 None] Remove volume export completed successfully. Jun 18 22:34:44.459825 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:34:44.480436 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (ee34e4f5-4c0f-4cf5-aab0-5f4c3bd0cba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:44.489715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab26b78-d169-4c2e-84bd-034724a84633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.509419 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab26b78-d169-4c2e-84bd-034724a84633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:34:44Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_dbb6a402-6bbb-4314-8339-efc34c5209b7',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9aba5e1-bbea-44c2-a838-bb8250dc671d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877d3d3b2044a089edd8b07f303d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:34:44Z,use_quota=True,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.516056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec577d39-fc0f-45a5-ac3e-2132476dbb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.520278 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec577d39-fc0f-45a5-ac3e-2132476dbb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.525620 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b892dca-4e7c-49a4-8d07-b41c2523d6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.529669 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b892dca-4e7c-49a4-8d07-b41c2523d6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'volume_name': 'volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.534539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75d981b-beb1-42c7-a9b2-065c48a1e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.538519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75d981b-beb1-42c7-a9b2-065c48a1e431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.543107 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cfe9de-6736-4632-aa2d-57ebfa3a9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.544167 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Volume f9aba5e1-bbea-44c2-a838-bb8250dc671d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'volume_size': 1} Jun 18 22:34:44.544754 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] creating volume 'volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:34:44.545956 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:44.612414 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:34:44.612836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:34:44.616573 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cfe9de-6736-4632-aa2d-57ebfa3a9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.621160 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe29cd-5d2b-4336-a392-2e8968439f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:44.631457 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d (f9aba5e1-bbea-44c2-a838-bb8250dc671d): created successfully Jun 18 22:34:44.635585 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe29cd-5d2b-4336-a392-2e8968439f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:44.641114 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (ee34e4f5-4c0f-4cf5-aab0-5f4c3bd0cba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:44.650885 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Created volume successfully. Jun 18 22:34:45.477365 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:34:46.242972 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:34:46.243783 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'f9aba5e1-bbea-44c2-a838-bb8250dc671d', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:34:46.260228 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Initialize volume connection completed successfully. Jun 18 22:34:47.241258 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=25,cinder:SELECT=66,cinder:INSERT=8,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:47.252886 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Terminate volume connection completed successfully. Jun 18 22:34:47.270428 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6adda952-02a0-449a-8d1e-c9295177852d tempest-VolumesBackupsAdminTest-343096894 None] Remove volume export completed successfully. Jun 18 22:34:47.366566 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:34:47.367720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:47.396483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:47.430711 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:34:47.652452 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-f9aba5e1-bbea-44c2-a838-bb8250dc671d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:34:47.686969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:48.117922 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:34:48.130668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] deleting rbd volume volume-f9aba5e1-bbea-44c2-a838-bb8250dc671d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:34:48.311297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Created reservations ['b60f2258-9b37-48c2-9aa2-421921365df0', '680439ea-e680-448a-800e-62b9fe5befcb', '95f253e3-9faa-4958-bb32-13af5938af9a', 'f5af0ba7-12ed-4e19-a395-bb16c4f1a453'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:48.358520 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:48.383459 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:48.408425 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:34:48.413505 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Deleted volume successfully. Jun 18 22:34:48.426285 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-842d31ce-af40-425d-b11b-3a2a5d870dcd tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-f9aba5e1-bbea-44c2-a838-bb8250dc671d-delete_volume'" released by "delete_volume" :: held 0.774s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:34:50.213578 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:34:50.237061 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (b5fb2fdc-49ba-4c63-8d83-d9efe27d2e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:50.244046 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c7f8f-0d9b-4fe2-908f-c3175fe62e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.260074 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c7f8f-0d9b-4fe2-908f-c3175fe62e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-2002690992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b14570d-fcc3-47d8-86e7-3c15b25f2617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf877d3d3b2044a089edd8b07f303d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:34:50Z,use_quota=True,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.265215 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bc0443-0484-4514-b5b2-63dae31f2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.270121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bc0443-0484-4514-b5b2-63dae31f2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.274983 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6424d00e-66c0-4970-adb6-9fd62f24ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.279044 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6424d00e-66c0-4970-adb6-9fd62f24ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'volume_name': 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.283785 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881ad75f-a850-4b7b-ab44-6da8c462cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.287544 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881ad75f-a850-4b7b-ab44-6da8c462cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.292116 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52ff088-2212-47d1-9423-1006153f9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.293190 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Volume 3b14570d-fcc3-47d8-86e7-3c15b25f2617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'volume_size': 1} Jun 18 22:34:50.293585 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] creating volume 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:34:50.294353 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:50.347370 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:34:50.347950 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:34:50.351644 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52ff088-2212-47d1-9423-1006153f9245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.356072 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc89071-43f9-4b93-927b-32fd058f67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:34:50.365380 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617 (3b14570d-fcc3-47d8-86e7-3c15b25f2617): created successfully Jun 18 22:34:50.368757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc89071-43f9-4b93-927b-32fd058f67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:34:50.374177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Flow 'volume_create_manager' (b5fb2fdc-49ba-4c63-8d83-d9efe27d2e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:34:50.382098 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e3ca2a65-4778-4d1d-86e7-3331a8085583 tempest-VolumesBackupsAdminTest-343096894 None] Created volume successfully. Jun 18 22:34:51.465122 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-18T22:34:51Z,data_timestamp=2022-06-18T22:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-100500383',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=abaf452d-f2a9-4671-8327-53af7b73bfc5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cf877d3d3b2044a089edd8b07f303d54',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2605f28a07b465cb9fd2c543a69c38e',volume_id=3b14570d-fcc3-47d8-86e7-3c15b25f2617) Jun 18 22:34:51.465122 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.backup.rpcapi [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] continue_backup in rpcapi backup_id abaf452d-f2a9-4671-8327-53af7b73bfc5 {{(pid=123873) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 18 22:34:51.626198 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:34:52.405579 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.778s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:34:52.406242 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '3b14570d-fcc3-47d8-86e7-3c15b25f2617', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:34:52.424660 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Initialize volume connection completed successfully. Jun 18 22:34:54.359028 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Terminate volume connection completed successfully. Jun 18 22:34:54.379769 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-ccae3e56-7d87-4105-9467-f75a12e5c388 tempest-VolumesBackupsAdminTest-343096894 None] Remove volume export completed successfully. Jun 18 22:34:55.884473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-3b14570d-fcc3-47d8-86e7-3c15b25f2617-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:34:55.926678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:56.240191 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:34:56.252418 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] deleting rbd volume volume-3b14570d-fcc3-47d8-86e7-3c15b25f2617 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:34:56.458626 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Created reservations ['352be6f0-6e06-4d44-8443-62a34946143d', 'a825ff85-0347-4ab7-aad7-c69d892e7b13', '238c97c9-9975-4e1a-8f35-8ee2fb3c4d6a', 'b2ca9c07-94c0-4697-8212-69d56d59d839'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:56.506678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:56.530956 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:56.560841 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:34:56.570390 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Deleted volume successfully. Jun 18 22:34:56.587299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-19125116-5f15-4917-8bc3-c98a5a6dc60f tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-3b14570d-fcc3-47d8-86e7-3c15b25f2617-delete_volume'" released by "delete_volume" :: held 0.703s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:34:57.038651 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-270411b1-acf4-4bd6-922a-7af233b7ff93-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:34:57.075678 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:57.247694 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Volume volume-270411b1-acf4-4bd6-922a-7af233b7ff93 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:34:57.273113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] deleting rbd volume volume-270411b1-acf4-4bd6-922a-7af233b7ff93 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:34:57.474843 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Created reservations ['de9d219c-0dc7-455a-a857-8e970607f246', '99e9f23e-39db-42c6-a7d5-14647ea7a9ae', '92806c45-3231-4e0c-bf84-9b6be9847eb9', '043193cf-20e0-489c-bd79-258127fbe142'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:34:57.521408 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:57.544247 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:34:57.573441 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:34:57.577489 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Deleted volume successfully. Jun 18 22:34:57.593790 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-240daf23-6b7d-45d7-be02-5b4c00e6d347 tempest-VolumesBackupsAdminTest-343096894 None] Lock "b'cinder-270411b1-acf4-4bd6-922a-7af233b7ff93-delete_volume'" released by "delete_volume" :: held 0.557s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:01.822979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:35:01.847717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Flow 'volume_create_manager' (0083c711-06d7-40a1-9c0d-ba5b4c0a03f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:01.855233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d80a7ac-dbff-418f-926f-fc720a61dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.861136 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:01.873911 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d80a7ac-dbff-418f-926f-fc720a61dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973229010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e34cdb7-6cae-465b-a4a0-fe997112e1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ac7afa8ff4ccda354f0ec7af80e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:35:02Z,use_quota=True,user_id='e8139edfa85b439c818f8eb10e0e31b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:01.879328 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e691a-f298-447f-ad16-6badbe558d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.884159 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e691a-f298-447f-ad16-6badbe558d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:01.889498 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb20bf7-a459-4d2c-86f7-65d61ce266ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.894545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb20bf7-a459-4d2c-86f7-65d61ce266ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e34cdb7-6cae-465b-a4a0-fe997112e1b9', 'volume_name': 'volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:01.899899 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb889210-7534-4bfc-ad69-f5e9fb7926be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.903815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb889210-7534-4bfc-ad69-f5e9fb7926be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:01.908667 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2358ff-71b7-4d3f-a7a8-4dac8f896717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.909788 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Volume 3e34cdb7-6cae-465b-a4a0-fe997112e1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9', 'volume_size': 1} Jun 18 22:35:01.910254 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] creating volume 'volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:35:01.910959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:01.978607 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:35:01.978991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:35:01.983003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2358ff-71b7-4d3f-a7a8-4dac8f896717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:01.988103 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a58b97-3b40-4877-8768-fb508b20c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:01.998680 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Volume volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9 (3e34cdb7-6cae-465b-a4a0-fe997112e1b9): created successfully Jun 18 22:35:02.002479 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a58b97-3b40-4877-8768-fb508b20c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:02.008412 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Flow 'volume_create_manager' (0083c711-06d7-40a1-9c0d-ba5b4c0a03f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:02.019821 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-b54545f9-f1dd-4f4b-bf40-63e417b4ba17 tempest-VolumesActionsTest-612307831 None] Created volume successfully. Jun 18 22:35:09.477245 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=66,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:09.489450 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-7fdfe4f9-d929-4021-8c74-18f5d81cc761 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['7a31f5f0-a356-4ab2-ad65-e0add0db6b35', 'eab25781-42de-4e7c-a4c8-811f6e7362e3', 'c8c21221-1d21-4e2e-8067-2e812bb5f421', 'b0d0b247-35aa-4afe-82bc-6c059960a636'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:35:09.535254 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7fdfe4f9-d929-4021-8c74-18f5d81cc761 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:35:09.541626 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-7fdfe4f9-d929-4021-8c74-18f5d81cc761 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-d4111b84-32e4-459c-aee2-cb15367e7ae0-delete_snapshot'" released by "delete_snapshot" :: held 30.310s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:10.376387 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-56c7a82c-29d8-46a8-b16a-1e9c1959acdd tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-d14e4294-7c13-44c9-ad6c-c3a5a39d6f24-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:10.378865 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-56c7a82c-29d8-46a8-b16a-1e9c1959acdd tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:14.978063 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4ef5b673-a4c2-45f0-9dbe-e0c63d357204 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9'" acquired by "attach_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:15.017648 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4ef5b673-a4c2-45f0-9dbe-e0c63d357204 tempest-VolumesActionsTest-612307831 None] Attaching volume 3e34cdb7-6cae-465b-a4a0-fe997112e1b9 to instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa at mountpoint /dev/sdb on host None. Jun 18 22:35:15.062048 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4ef5b673-a4c2-45f0-9dbe-e0c63d357204 tempest-VolumesActionsTest-612307831 None] Attach volume completed successfully. Jun 18 22:35:15.067012 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4ef5b673-a4c2-45f0-9dbe-e0c63d357204 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9'" released by "attach_volume" :: held 0.089s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:15.195647 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1b88ac6e-7219-4a4a-92ef-d1082599bf72 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:15.196427 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1b88ac6e-7219-4a4a-92ef-d1082599bf72 tempest-VolumesActionsTest-612307831 None] Detaching volume 3e34cdb7-6cae-465b-a4a0-fe997112e1b9 from instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa. Jun 18 22:35:15.243301 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1b88ac6e-7219-4a4a-92ef-d1082599bf72 tempest-VolumesActionsTest-612307831 None] Detach volume completed successfully. Jun 18 22:35:15.251693 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1b88ac6e-7219-4a4a-92ef-d1082599bf72 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-detach_volume'" released by "detach_volume" :: held 0.056s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:33.830374 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0cb2c753-57ff-4572-be8a-1c29833be581 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9'" acquired by "attach_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:33.834447 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=23,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:33.874270 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0cb2c753-57ff-4572-be8a-1c29833be581 tempest-VolumesActionsTest-612307831 None] Attaching volume 3e34cdb7-6cae-465b-a4a0-fe997112e1b9 to instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 at mountpoint /dev/sdb on host None. Jun 18 22:35:33.902287 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-0cb2c753-57ff-4572-be8a-1c29833be581 tempest-VolumesActionsTest-612307831 None] Attach volume completed successfully. Jun 18 22:35:33.910086 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-0cb2c753-57ff-4572-be8a-1c29833be581 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9'" released by "attach_volume" :: held 0.080s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:34.112486 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e0dbe69f-0ef0-4af3-842d-7ed2de69cc03 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:34.113140 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e0dbe69f-0ef0-4af3-842d-7ed2de69cc03 tempest-VolumesActionsTest-612307831 None] Detaching volume 3e34cdb7-6cae-465b-a4a0-fe997112e1b9 from instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891. Jun 18 22:35:34.198411 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e0dbe69f-0ef0-4af3-842d-7ed2de69cc03 tempest-VolumesActionsTest-612307831 None] Detach volume completed successfully. Jun 18 22:35:34.204135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e0dbe69f-0ef0-4af3-842d-7ed2de69cc03 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-detach_volume'" released by "detach_volume" :: held 0.092s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:38.382210 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-6a6aacb4-ad08-494d-99ae-af96843d3460 req-637bed50-3265-4133-9d0c-6a6054e5e109 tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:35:38.382929 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-6a6aacb4-ad08-494d-99ae-af96843d3460 req-637bed50-3265-4133-9d0c-6a6054e5e109 tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment a4dad367-b10a-4333-ab46-f01996b68a53. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:35:39.490336 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-7cb3eda7-c3d9-4e18-b948-ac5f7da40a30 tempest-VolumesActionsTest-612307831 None] Running cmd (subprocess): rbd export --pool volumes volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9 /opt/stack/data/cinder/conversion/volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-681b06b3-068f-403a-904d-52661cef88e3 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:35:40.561276 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=39,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:40.681376 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-56c7a82c-29d8-46a8-b16a-1e9c1959acdd tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['7b8c8cae-a7c8-4cbc-bd70-32272faaa5bf', '65a339e9-6e79-46e3-919e-1395c26aaec0', '3622ec1e-9edb-4d6a-9c3d-aab72f68dc78', 'e83f8166-4bc6-4907-91b7-20678278cb2f'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:35:40.767669 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-56c7a82c-29d8-46a8-b16a-1e9c1959acdd tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:35:40.777968 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-56c7a82c-29d8-46a8-b16a-1e9c1959acdd tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-d14e4294-7c13-44c9-ad6c-c3a5a39d6f24-delete_snapshot'" released by "delete_snapshot" :: held 30.403s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:40.824153 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [None req-7cb3eda7-c3d9-4e18-b948-ac5f7da40a30 tempest-VolumesActionsTest-612307831 None] CMD "rbd export --pool volumes volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9 /opt/stack/data/cinder/conversion/volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-681b06b3-068f-403a-904d-52661cef88e3 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.334s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:35:40.833896 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.image_utils [None req-7cb3eda7-c3d9-4e18-b948-ac5f7da40a30 tempest-VolumesActionsTest-612307831 None] 681b06b3-068f-403a-904d-52661cef88e3 was raw, no need to convert to raw {{(pid=123873) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}} Jun 18 22:35:43.543542 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-eea18682-439f-400a-8a1a-109531033419 req-47d36bb1-21dc-4e98-a9df-d89f7e1ec81c tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:35:43.912258 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 req-92a5c12f-b0e0-4211-bc3d-f544da2b0a7d tempest-VolumesSnapshotTestJSON-1142548725 None] Terminate volume connection completed successfully. Jun 18 22:35:43.912981 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 req-92a5c12f-b0e0-4211-bc3d-f544da2b0a7d tempest-VolumesSnapshotTestJSON-1142548725 None] Deleting attachment 1bcfbb77-5715-42b1-a947-61bbcc622ba5. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:35:45.019340 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-eea18682-439f-400a-8a1a-109531033419 req-47d36bb1-21dc-4e98-a9df-d89f7e1ec81c tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.476s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:35:45.020168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-eea18682-439f-400a-8a1a-109531033419 req-47d36bb1-21dc-4e98-a9df-d89f7e1ec81c tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:35:45.087807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-eea18682-439f-400a-8a1a-109531033419 req-47d36bb1-21dc-4e98-a9df-d89f7e1ec81c tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '92eb6127-5f06-4961-a0f5-c7fb19e61c04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a5c07bc2-6c7c-42ce-9c27-ded2aa274fd4'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:35:45.191496 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-eea18682-439f-400a-8a1a-109531033419 req-47d36bb1-21dc-4e98-a9df-d89f7e1ec81c tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:35:47.366894 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:35:47.368399 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:47.462942 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:47.538977 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:35:50.682862 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:35:50.708463 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (3a54b51c-d570-4849-b6e6-652372908b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:50.718566 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b2b175-9ca8-4719-9e3c-e25c3462e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.741245 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b2b175-9ca8-4719-9e3c-e25c3462e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1807812146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9407c9dd-c740-48a3-93e2-3b1ecc7fee4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:35:51Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.746898 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3306b0-8516-43fc-8fdc-c9f891ac97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.751354 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3306b0-8516-43fc-8fdc-c9f891ac97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.756565 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596b2dbd-c912-479b-90b4-63382aaaf128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.761799 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596b2dbd-c912-479b-90b4-63382aaaf128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9407c9dd-c740-48a3-93e2-3b1ecc7fee4d', 'volume_name': 'volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.766620 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5e742-ac88-477e-a899-4b16fcb8edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.771460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5e742-ac88-477e-a899-4b16fcb8edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.778114 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a77e74-e3c7-4aa7-84c2-706d28f252d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.779570 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume 9407c9dd-c740-48a3-93e2-3b1ecc7fee4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d', 'volume_size': 1} Jun 18 22:35:50.780904 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] creating volume 'volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:35:50.782016 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:50.915558 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:35:50.916017 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:35:50.924413 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a77e74-e3c7-4aa7-84c2-706d28f252d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.932392 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6491d-f35b-43ba-bfab-3b280c631a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:50.949806 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d (9407c9dd-c740-48a3-93e2-3b1ecc7fee4d): created successfully Jun 18 22:35:50.955574 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6491d-f35b-43ba-bfab-3b280c631a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:50.962098 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (3a54b51c-d570-4849-b6e6-652372908b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:50.977859 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-aead8587-20b5-468b-8e1f-ffb428a4f1f0 tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:35:51.960737 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-872a584d-c1b5-4f6c-8fa7-61605802ef39 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:52.637639 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-872a584d-c1b5-4f6c-8fa7-61605802ef39 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:35:53.866323 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:35:53.920666 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (ad247050-b2f1-4698-84e2-41308253e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:53.927894 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23062e27-f67b-40c8-b18b-4ceaa6adda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:53.947372 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23062e27-f67b-40c8-b18b-4ceaa6adda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1808295637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2764cb4c-2d8d-4682-bad9-a3c81b1f4cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:35:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5c318418-d987-49f4-8141-0d90f574ff83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:35:54Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:53.957890 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b151fa53-d5bb-45db-a29a-6e1ed68db307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:53.963406 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b151fa53-d5bb-45db-a29a-6e1ed68db307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:53.969284 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17da1aa-54bb-43b0-be20-a1d69075f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:53.975490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17da1aa-54bb-43b0-be20-a1d69075f06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2764cb4c-2d8d-4682-bad9-a3c81b1f4cde', 'volume_name': 'volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde', 'volume_size': 2, 'snapshot_id': '5c318418-d987-49f4-8141-0d90f574ff83'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:53.982088 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82898db-c539-4456-901a-5c6fa4437e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:53.987519 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82898db-c539-4456-901a-5c6fa4437e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:53.994437 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c920b7c0-0c39-44f7-a0f3-76808da88d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:53.997980 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume 2764cb4c-2d8d-4682-bad9-a3c81b1f4cde: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde', 'volume_size': 2, 'snapshot_id': '5c318418-d987-49f4-8141-0d90f574ff83'} Jun 18 22:35:54.053173 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] cloning volumes/volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d@snapshot-5c318418-d987-49f4-8141-0d90f574ff83 to volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:35:54.054201 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:54.162847 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:54.358170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:35:54.358170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:35:54.367166 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:54.597161 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c920b7c0-0c39-44f7-a0f3-76808da88d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde', 'volume_size': 2, 'snapshot_id': '5c318418-d987-49f4-8141-0d90f574ff83'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:54.602409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bece61-a086-4515-812e-43e85ff447d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:54.621414 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde (2764cb4c-2d8d-4682-bad9-a3c81b1f4cde): created successfully Jun 18 22:35:54.626616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bece61-a086-4515-812e-43e85ff447d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:54.634155 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (ad247050-b2f1-4698-84e2-41308253e347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:54.671875 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-28d9144b-9539-481d-90c7-08c4b764afa4 tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:35:55.031077 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:35:55.120033 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:55.213849 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:35:55.236186 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:35:55.689673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['324b414d-d205-48ed-bf05-5949c3cf8ba9', 'f6e7bcae-0749-4446-9a4c-aad197347890', '8d948d26-42ac-4f5e-b25d-13755356a26e', '95244ab2-be8f-43d8-8af8-f5e73f916098'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:35:55.814870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:55.846079 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:55.910251 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:35:55.923478 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:35:55.945056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-8a642d01-ae75-4e47-ab90-9e3cb21a282d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-2764cb4c-2d8d-4682-bad9-a3c81b1f4cde-delete_volume'" released by "delete_volume" :: held 0.917s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:35:57.028993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:35:57.055177 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (12a68e95-07fe-4717-8a8a-081701c694e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:57.062457 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b90edab-8139-4557-a149-1051b9a1ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.082198 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b90edab-8139-4557-a149-1051b9a1ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120556915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ddefe3fe-7465-42d1-8102-7df609415d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:35:57Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.095215 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3333a04f-61aa-4f3c-bca6-15a89581006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.105262 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3333a04f-61aa-4f3c-bca6-15a89581006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.116352 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e409f45-6036-4d62-b3b3-df0a2cf196d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.120707 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e409f45-6036-4d62-b3b3-df0a2cf196d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddefe3fe-7465-42d1-8102-7df609415d23', 'volume_name': 'volume-ddefe3fe-7465-42d1-8102-7df609415d23', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.125892 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cec0cc5-46ef-41a5-978b-9c1fe7d30682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.130285 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cec0cc5-46ef-41a5-978b-9c1fe7d30682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.136250 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149be011-b39c-46db-a042-c12400e1ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.137778 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume ddefe3fe-7465-42d1-8102-7df609415d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddefe3fe-7465-42d1-8102-7df609415d23', 'volume_size': 1} Jun 18 22:35:57.138478 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] creating volume 'volume-ddefe3fe-7465-42d1-8102-7df609415d23' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:35:57.139440 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:57.297483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:35:57.298200 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:35:57.302842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149be011-b39c-46db-a042-c12400e1ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddefe3fe-7465-42d1-8102-7df609415d23', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.315216 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2b083e-a1b9-45ef-925a-e81b52925a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:35:57.335891 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-ddefe3fe-7465-42d1-8102-7df609415d23 (ddefe3fe-7465-42d1-8102-7df609415d23): created successfully Jun 18 22:35:57.339508 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2b083e-a1b9-45ef-925a-e81b52925a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:35:57.345355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (12a68e95-07fe-4717-8a8a-081701c694e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:35:57.358444 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-465b7135-c90d-442b-8525-aed5a390a026 tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:35:58.696468 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=72,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:58.726715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-dfa15c3f-98b0-4020-95be-6cdfaf33a0a7 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:35:59.856331 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-dfa15c3f-98b0-4020-95be-6cdfaf33a0a7 tempest-VolumesSnapshotTestJSON-1142548725 None] Create snapshot completed successfully Jun 18 22:36:01.704472 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:36:01.743364 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (7299a723-8fb2-48f2-8e2d-53df0eddfa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:01.750671 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f323ff6c-061d-4db4-999f-8a52441031e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:01.768490 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f323ff6c-061d-4db4-999f-8a52441031e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-495288374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abfcd315-c379-4a7c-85dd-53186b500e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65dfa8232fa458fb3c49822a1f4ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66ef6e5a-87bd-4149-834a-3f5244d758a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:36:02Z,use_quota=True,user_id='61121749f1aa4a2285c8f270abb74fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:01.774310 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9566f-4c8f-4566-9e2a-33877492818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:01.778567 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9566f-4c8f-4566-9e2a-33877492818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:01.785064 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72e6feb-4a4e-4c84-a10f-52467e44613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:01.787791 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72e6feb-4a4e-4c84-a10f-52467e44613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abfcd315-c379-4a7c-85dd-53186b500e7f', 'volume_name': 'volume-abfcd315-c379-4a7c-85dd-53186b500e7f', 'volume_size': 1, 'snapshot_id': '66ef6e5a-87bd-4149-834a-3f5244d758a6'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:01.792806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77842c-692b-491b-898c-54ac4cbc2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:01.796693 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77842c-692b-491b-898c-54ac4cbc2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:01.802103 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf07183-8847-4d24-887e-cc6d40aad1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:01.803267 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Volume abfcd315-c379-4a7c-85dd-53186b500e7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abfcd315-c379-4a7c-85dd-53186b500e7f', 'volume_size': 1, 'snapshot_id': '66ef6e5a-87bd-4149-834a-3f5244d758a6'} Jun 18 22:36:01.824229 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=65,cinder:INSERT=4,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:01.852197 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] cloning volumes/volume-ddefe3fe-7465-42d1-8102-7df609415d23@snapshot-66ef6e5a-87bd-4149-834a-3f5244d758a6 to volume-abfcd315-c379-4a7c-85dd-53186b500e7f {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:36:01.852848 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:01.937997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:02.159343 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:36:02.159807 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:36:02.194365 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf07183-8847-4d24-887e-cc6d40aad1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfcd315-c379-4a7c-85dd-53186b500e7f', 'volume_size': 1, 'snapshot_id': '66ef6e5a-87bd-4149-834a-3f5244d758a6'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:02.199158 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8132e07f-9ab4-482e-9ad2-d5ed4315a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:02.213894 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-abfcd315-c379-4a7c-85dd-53186b500e7f (abfcd315-c379-4a7c-85dd-53186b500e7f): created successfully Jun 18 22:36:02.217460 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8132e07f-9ab4-482e-9ad2-d5ed4315a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:02.223099 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Flow 'volume_create_manager' (7299a723-8fb2-48f2-8e2d-53df0eddfa0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:02.244407 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-cb88c702-adc6-4f7b-88eb-805defb6616e tempest-VolumesSnapshotTestJSON-1142548725 None] Created volume successfully. Jun 18 22:36:02.903073 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-abfcd315-c379-4a7c-85dd-53186b500e7f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:02.959208 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:03.087717 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:03.095855 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-abfcd315-c379-4a7c-85dd-53186b500e7f {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:03.573551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['d66ddc21-46f5-4738-b08e-feaa6b6ca1a5', 'cc633d8d-cd1c-429d-a985-cc645753dec8', '3ef8b837-b812-4e93-a603-ba04dd777d29', '66f56ebc-6994-47e5-bd92-0434fe1f6efa'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:03.667712 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:03.730383 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:03.769456 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:03.774535 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:36:03.798409 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-067216d4-46c1-4902-a1ee-2ca15610b77d tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-abfcd315-c379-4a7c-85dd-53186b500e7f-delete_volume'" released by "delete_volume" :: held 0.896s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:04.265568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1bb0a923-fe68-4f48-bfdd-9249465685c2 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-66ef6e5a-87bd-4149-834a-3f5244d758a6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:04.268972 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1bb0a923-fe68-4f48-bfdd-9249465685c2 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:04.980037 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-1bb0a923-fe68-4f48-bfdd-9249465685c2 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['e0368cb2-73c2-4e2b-8c03-9a9605afd092', '7271c23e-0814-4ca1-b05a-1f9bb06191eb', 'fc27da6b-db66-4d9c-ae2d-a00a705c87c8', '781be544-c2e0-41c9-b7bf-17b4f6f6cbaf'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:05.095921 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1bb0a923-fe68-4f48-bfdd-9249465685c2 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:36:05.108575 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1bb0a923-fe68-4f48-bfdd-9249465685c2 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-66ef6e5a-87bd-4149-834a-3f5244d758a6-delete_snapshot'" released by "delete_snapshot" :: held 0.843s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:05.431995 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-ddefe3fe-7465-42d1-8102-7df609415d23-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:05.530403 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:05.668096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:05.668467 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-ddefe3fe-7465-42d1-8102-7df609415d23 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:05.686858 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-ddefe3fe-7465-42d1-8102-7df609415d23 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:06.103137 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['8ecda60d-16ef-4444-81d8-aa2c73987598', '83f05637-709f-44cd-96a4-1a9c85f3cc28', 'bb9ea5d3-fac3-46fb-acf1-13f4edbd8fbc', '0113ad35-a750-4dcc-84a9-53d0719d0b04'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:06.202605 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:06.272236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:06.341106 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:06.351694 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:36:06.380912 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-1451a034-309e-4aa2-b32e-46a1f83390da tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-ddefe3fe-7465-42d1-8102-7df609415d23-delete_volume'" released by "delete_volume" :: held 0.949s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:06.740673 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2c2aebe7-0d7d-4f77-827a-5234c35cf08f tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-5c318418-d987-49f4-8141-0d90f574ff83-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:06.744042 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2c2aebe7-0d7d-4f77-827a-5234c35cf08f tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:08.126448 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-2c2aebe7-0d7d-4f77-827a-5234c35cf08f tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['b8881720-f071-400d-a30b-63390a9920ab', '95b897c0-fe0f-4f36-bc4d-1cc8e16320be', 'cd2aaabb-f3c0-4abf-9d1b-5f8755f6c7bd', 'c1be45a1-144e-4562-b9f1-d86b06abd7f9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:08.224975 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-2c2aebe7-0d7d-4f77-827a-5234c35cf08f tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:36:08.236293 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2c2aebe7-0d7d-4f77-827a-5234c35cf08f tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-5c318418-d987-49f4-8141-0d90f574ff83-delete_snapshot'" released by "delete_snapshot" :: held 1.496s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:09.158584 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:09.268779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:09.393943 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:09.394645 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:09.402216 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:09.782240 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=8 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:09.845993 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['26d78bfd-b0ed-4f06-8f49-c66b1a1571ea', 'd9fe6a9d-6259-4eef-84d0-320abc99e26d', 'dc0ea688-ff93-4220-aa38-ca8521f75fb2', 'f868079c-1ae0-4de8-b6d6-5009f33f79e3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:09.868492 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=60,cinder:DELETE=1,cinder:INSERT=11,cinder:UPDATE=28 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:09.958357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:10.070936 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:10.168370 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:10.176101 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:36:10.208897 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-72e9a63d-5f14-429e-ad28-b693cc59bbd5 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-9407c9dd-c740-48a3-93e2-3b1ecc7fee4d-delete_volume'" released by "delete_volume" :: held 1.056s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:10.867789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-f6719241-2450-4c57-9569-6470077a1b0e-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:10.985751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:11.196836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:11.211777 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-f6719241-2450-4c57-9569-6470077a1b0e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:11.500477 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:36:11.607539 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] deleting parent snapshot volume-f6719241-2450-4c57-9569-6470077a1b0e.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:36:12.290553 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['c00f74e9-c981-4424-8ea7-9e487ffee5a7', 'a31e4aed-d1d4-42b0-a108-968bf58302a6', '72fc035c-9722-470c-b411-3f57ea590c99', 'd8f54e41-6211-46a5-8188-ee2ad838c385'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:12.405749 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:12.475617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:12.539032 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:12.546210 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:36:12.578866 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-9d67f3eb-011f-4738-987b-69b5cdd345ee tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-f6719241-2450-4c57-9569-6470077a1b0e-delete_volume'" released by "delete_volume" :: held 1.711s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:13.240998 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e25a88d5-7ad6-416a-b44b-0a96473673d0 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-92c8fd42-8bc0-49e1-9cc0-424f61d17e4b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.044s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:13.249986 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-e25a88d5-7ad6-416a-b44b-0a96473673d0 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:14.358464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-e25a88d5-7ad6-416a-b44b-0a96473673d0 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['0feff371-f239-403e-be08-41d6057f4967', 'b87d304e-894b-475a-9b18-2610d80aad6b', '2a0d89b3-002e-4981-860e-0a32cfc39ea7', '019f529d-e8a4-4733-8952-d8ab69ff3a3e'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:14.498193 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-e25a88d5-7ad6-416a-b44b-0a96473673d0 tempest-VolumesSnapshotTestJSON-1142548725 None] Delete snapshot completed successfully. Jun 18 22:36:14.504148 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-e25a88d5-7ad6-416a-b44b-0a96473673d0 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-92c8fd42-8bc0-49e1-9cc0-424f61d17e4b-delete_snapshot'" released by "delete_snapshot" :: held 1.267s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:15.221695 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7cb3eda7-c3d9-4e18-b948-ac5f7da40a30 tempest-VolumesActionsTest-612307831 None] Uploaded volume to glance image-id: 681b06b3-068f-403a-904d-52661cef88e3. {{(pid=123873) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1751}} Jun 18 22:36:15.241537 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7cb3eda7-c3d9-4e18-b948-ac5f7da40a30 tempest-VolumesActionsTest-612307831 None] Copy volume to image completed successfully. Jun 18 22:36:15.432609 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-0bb96dac-d22f-48b7-8475-af7c0c8e42d2-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:15.515170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:15.598368 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:15.598793 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Volume volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:15.618680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] deleting rbd volume volume-0bb96dac-d22f-48b7-8475-af7c0c8e42d2 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:16.066168 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Created reservations ['e79ce30f-6263-4498-a68f-5d341638c75e', 'fadecc40-f83a-4832-9a12-ab799e16fc87', 'a19b52ce-367a-4725-8d46-b393b5136e14', '2ecd009d-cc20-49a2-83f9-690b3f7296d5'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:16.180399 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:16.306253 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:16.400898 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:16.418750 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Deleted volume successfully. Jun 18 22:36:16.441151 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-31142907-9621-4dc8-a2ae-6c83526c5a28 tempest-VolumesSnapshotTestJSON-1142548725 None] Lock "b'cinder-0bb96dac-d22f-48b7-8475-af7c0c8e42d2-delete_volume'" released by "delete_volume" :: held 1.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:17.196565 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:17.207584 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:INSERT=6,cinder:UPDATE=43,cinder:SELECT=49,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:17.270038 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:17.371602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:17.372480 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Volume volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:17.378809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] deleting rbd volume volume-3e34cdb7-6cae-465b-a4a0-fe997112e1b9 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:17.733568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Created reservations ['31788b68-3711-49f0-bd83-7fa41bc1290b', 'e5115ac1-50ef-4178-9644-3038868cbaae', '384f8c9d-8406-46c3-a89f-58b291aee8ba', '7306039d-cf1e-4609-8512-e792d3bf5dc1'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:17.837260 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:17.911596 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:17.969690 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:17.975252 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Deleted volume successfully. Jun 18 22:36:17.991113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-45691c33-48a1-4152-af9d-c0ca746b8fb7 tempest-VolumesActionsTest-612307831 None] Lock "b'cinder-3e34cdb7-6cae-465b-a4a0-fe997112e1b9-delete_volume'" released by "delete_volume" :: held 0.795s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:20.721101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:36:20.750473 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (49f4e4cf-e979-4416-ba99-925f10c84d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:20.757472 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bdfcb6-e40a-420a-bee8-195c5dc61d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.773975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bdfcb6-e40a-420a-bee8-195c5dc61d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1873177215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44e07d01-b903-4971-8953-b518186a89aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8e21aaf75c249daadb15c6ee8fd02b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:36:21Z,use_quota=True,user_id='6e0b18a739584c409cd4aaadb7bc9171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.779229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffedae1e-4314-4701-890d-e4e0d579b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.783615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffedae1e-4314-4701-890d-e4e0d579b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.788869 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2977136a-ddf3-4835-bcdd-a74333b7f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.792873 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2977136a-ddf3-4835-bcdd-a74333b7f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e07d01-b903-4971-8953-b518186a89aa', 'volume_name': 'volume-44e07d01-b903-4971-8953-b518186a89aa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.798152 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7aaff-ef2f-42a2-8973-62ed7c65ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.803048 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c7aaff-ef2f-42a2-8973-62ed7c65ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.807771 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550b0ba-5364-405e-b18d-3d532fa75b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.810477 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Volume 44e07d01-b903-4971-8953-b518186a89aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e07d01-b903-4971-8953-b518186a89aa', 'volume_size': 1} Jun 18 22:36:20.811015 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] creating volume 'volume-44e07d01-b903-4971-8953-b518186a89aa' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:36:20.812051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:20.886914 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:36:20.887677 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:36:20.892634 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550b0ba-5364-405e-b18d-3d532fa75b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e07d01-b903-4971-8953-b518186a89aa', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.898385 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48815c3-0364-417a-abb9-7168f2b5bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:20.909397 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Volume volume-44e07d01-b903-4971-8953-b518186a89aa (44e07d01-b903-4971-8953-b518186a89aa): created successfully Jun 18 22:36:20.913292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48815c3-0364-417a-abb9-7168f2b5bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:20.919115 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (49f4e4cf-e979-4416-ba99-925f10c84d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:20.929942 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-6be6060c-9a01-450b-89f7-b32d1cd6f795 tempest-VolumesListTestJSON-919921199 None] Created volume successfully. Jun 18 22:36:22.406218 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:36:22.436835 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (0be9aa77-f459-4bda-adea-05c6912c0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:22.444888 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7cfbf5-667b-4eed-b843-98d79d5bafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.463996 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7cfbf5-667b-4eed-b843-98d79d5bafd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696814395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=114065a3-dc62-4683-8003-163b4a4d864a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8e21aaf75c249daadb15c6ee8fd02b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:36:22Z,use_quota=True,user_id='6e0b18a739584c409cd4aaadb7bc9171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.471333 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70be01f-74c5-4530-ad35-b8a7d352c63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.476032 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70be01f-74c5-4530-ad35-b8a7d352c63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.482483 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db31f9-a187-4727-873e-9b12841ce98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.487909 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db31f9-a187-4727-873e-9b12841ce98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114065a3-dc62-4683-8003-163b4a4d864a', 'volume_name': 'volume-114065a3-dc62-4683-8003-163b4a4d864a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.493764 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d6a060-5aef-4b13-922c-f36815b2cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.498746 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d6a060-5aef-4b13-922c-f36815b2cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.504157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f968cc6-8cb7-49b1-89d9-cb7eb7413cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.505452 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Volume 114065a3-dc62-4683-8003-163b4a4d864a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114065a3-dc62-4683-8003-163b4a4d864a', 'volume_size': 1} Jun 18 22:36:22.506113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] creating volume 'volume-114065a3-dc62-4683-8003-163b4a4d864a' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:36:22.506946 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:22.606709 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:36:22.607346 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:36:22.611928 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f968cc6-8cb7-49b1-89d9-cb7eb7413cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114065a3-dc62-4683-8003-163b4a4d864a', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.617178 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3991923a-3d8d-45f8-b7ac-5fceefb2026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:22.632941 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Volume volume-114065a3-dc62-4683-8003-163b4a4d864a (114065a3-dc62-4683-8003-163b4a4d864a): created successfully Jun 18 22:36:22.642299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3991923a-3d8d-45f8-b7ac-5fceefb2026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:22.649317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (0be9aa77-f459-4bda-adea-05c6912c0f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:22.666624 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-225a4733-569f-4637-b570-6a639b37d7f7 tempest-VolumesListTestJSON-919921199 None] Created volume successfully. Jun 18 22:36:24.056380 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:36:24.086779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (575dcd38-a5bc-45cc-bca1-9d42a145f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:24.094209 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867ebce-4de2-4655-ae4f-cbf4937a0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.113462 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867ebce-4de2-4655-ae4f-cbf4937a0f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-323484876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ef32968-4fe0-4f71-bcbb-a84f7d26f55e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8e21aaf75c249daadb15c6ee8fd02b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:36:24Z,use_quota=True,user_id='6e0b18a739584c409cd4aaadb7bc9171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.121236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e15ae23-223b-411e-9138-7b69ae446d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.127444 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e15ae23-223b-411e-9138-7b69ae446d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.135260 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3b58b-c528-4903-9b6f-02893b03524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.140058 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a3b58b-c528-4903-9b6f-02893b03524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef32968-4fe0-4f71-bcbb-a84f7d26f55e', 'volume_name': 'volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.145080 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2dad3-2d4b-4c39-8ab1-899aff6469fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.149122 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d2dad3-2d4b-4c39-8ab1-899aff6469fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.153848 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830d7532-af82-4b5b-b930-4ac34564c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.155098 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Volume 7ef32968-4fe0-4f71-bcbb-a84f7d26f55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e', 'volume_size': 1} Jun 18 22:36:24.155620 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] creating volume 'volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:36:24.156403 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:24.255926 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:36:24.257632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:36:24.266861 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830d7532-af82-4b5b-b930-4ac34564c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.275203 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181b6b8-cffe-43bb-a953-24ac17fa6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:24.289568 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Volume volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e (7ef32968-4fe0-4f71-bcbb-a84f7d26f55e): created successfully Jun 18 22:36:24.299949 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0181b6b8-cffe-43bb-a953-24ac17fa6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:24.308834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Flow 'volume_create_manager' (575dcd38-a5bc-45cc-bca1-9d42a145f112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:24.328029 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-74e1cfda-e7f2-4cf4-9f36-cefc40390a88 tempest-VolumesListTestJSON-919921199 None] Created volume successfully. Jun 18 22:36:28.852808 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:28.955676 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:29.050097 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:29.051990 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Volume volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:29.066798 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] deleting rbd volume volume-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:29.622139 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=28,cinder:SELECT=63,cinder:DELETE=2,cinder:INSERT=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:29.732285 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Created reservations ['b93131b4-3eb5-4545-99b0-ead9501bb4c6', '3a5f7f6f-20f9-4b91-9e15-7792ab91ec59', 'eb9767db-be2b-426d-b729-e67009906c3d', 'e3530132-d68d-4d66-a132-2363ed43cf99'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:29.855359 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:29.927185 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:29.999985 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:30.011392 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Deleted volume successfully. Jun 18 22:36:30.035975 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-2da063bc-3ec5-4d3f-ac23-f22dbcea2b11 tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-7ef32968-4fe0-4f71-bcbb-a84f7d26f55e-delete_volume'" released by "delete_volume" :: held 1.183s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:30.157618 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-114065a3-dc62-4683-8003-163b4a4d864a-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:30.276116 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:30.368546 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:30.372504 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Volume volume-114065a3-dc62-4683-8003-163b4a4d864a is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:30.383792 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] deleting rbd volume volume-114065a3-dc62-4683-8003-163b4a4d864a {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:31.061613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Created reservations ['49c2b555-5a59-437b-af29-7a3b224ed7fd', '772d2e21-03d5-424f-a2d1-a8fbb4a3f14a', '0521c9be-8afc-4678-8a38-8d6cd5f20b72', '84827fcb-a853-4b4d-9a68-35f210f696a3'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:31.176153 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:31.278538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:31.378925 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:31.390980 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Deleted volume successfully. Jun 18 22:36:31.418805 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fd1afc58-f12a-4d7a-b3d1-5ef01624b2ba tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-114065a3-dc62-4683-8003-163b4a4d864a-delete_volume'" released by "delete_volume" :: held 1.263s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:31.474875 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-44e07d01-b903-4971-8953-b518186a89aa-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:31.538920 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=55,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:31.540846 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:31.638815 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:31.641065 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Volume volume-44e07d01-b903-4971-8953-b518186a89aa is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:31.649143 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] deleting rbd volume volume-44e07d01-b903-4971-8953-b518186a89aa {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:32.211133 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Created reservations ['53881dd4-b7f8-459b-b678-c3c57cd6f271', 'c21da0ab-d96d-4304-8080-92a6764fb8bd', '4edc7242-70dd-47ff-8d09-35c6818336d2', '77ddf6c2-7234-4531-9e32-cf04d592ffbc'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:32.302773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:32.394029 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:32.458309 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:32.490157 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Deleted volume successfully. Jun 18 22:36:32.514494 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bc78971c-cc03-4ba3-ad94-3dadabe0c76b tempest-VolumesListTestJSON-919921199 None] Lock "b'cinder-44e07d01-b903-4971-8953-b518186a89aa-delete_volume'" released by "delete_volume" :: held 1.040s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:35.431267 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:36:35.456081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Flow 'volume_create_manager' (203fb4e8-4f5a-4901-add7-7839abf03ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:35.462928 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b89ed7-4c66-492b-b9ae-2e2563e3f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.480520 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b89ed7-4c66-492b-b9ae-2e2563e3f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1704225457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be6a528e-0791-4965-8d53-6ee17fee7fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65538816264444282c3b4d86668802f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:36:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:36:35Z,use_quota=True,user_id='5f6175e1c1d74ee0b15318a95e0980e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.486018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bc3b05-e603-4043-a5cf-e6d8f0a21b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.490235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bc3b05-e603-4043-a5cf-e6d8f0a21b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.495687 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ff393-ba7f-4eda-b49f-00783525a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.499814 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ff393-ba7f-4eda-b49f-00783525a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6a528e-0791-4965-8d53-6ee17fee7fea', 'volume_name': 'volume-be6a528e-0791-4965-8d53-6ee17fee7fea', 'volume_size': 2}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.504918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320f82a4-fdfb-49c8-b7be-6b61181c41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.508859 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320f82a4-fdfb-49c8-b7be-6b61181c41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.513613 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8e4dbb-ce18-4183-b2ae-f901ad540680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.514942 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Volume be6a528e-0791-4965-8d53-6ee17fee7fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6a528e-0791-4965-8d53-6ee17fee7fea', 'volume_size': 2} Jun 18 22:36:35.515486 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] creating volume 'volume-be6a528e-0791-4965-8d53-6ee17fee7fea' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:36:35.516384 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:35.582516 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:36:35.583296 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:36:35.588572 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8e4dbb-ce18-4183-b2ae-f901ad540680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6a528e-0791-4965-8d53-6ee17fee7fea', 'volume_size': 2}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.593378 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c45440-9201-4c4b-8880-9de0aa45379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:36:35.603317 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Volume volume-be6a528e-0791-4965-8d53-6ee17fee7fea (be6a528e-0791-4965-8d53-6ee17fee7fea): created successfully Jun 18 22:36:35.608464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c45440-9201-4c4b-8880-9de0aa45379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:36:35.616661 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Flow 'volume_create_manager' (203fb4e8-4f5a-4901-add7-7839abf03ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:36:35.626201 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7a0c8642-415e-40af-b31b-54cc9b1accc2 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Created volume successfully. Jun 18 22:36:36.788196 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c5c4f7f7-7269-4df1-b96b-44f7235596bf tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:37.398437 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c5c4f7f7-7269-4df1-b96b-44f7235596bf tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Create snapshot completed successfully Jun 18 22:36:38.064560 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c354ee1d-8efc-468f-878e-8130e192308b tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Lock "b'cinder-22ab40b5-9325-4cf5-bad6-640c828191be-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:38.067632 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-c354ee1d-8efc-468f-878e-8130e192308b tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:38.385474 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-c354ee1d-8efc-468f-878e-8130e192308b tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Created reservations ['70872f63-362a-4cbc-b0f5-728b82d6b37a', '79c6b3c5-a230-4f43-a536-c4f697cc7038', 'daa84282-44bc-40bf-ba39-498d51c0590e', '0859d37a-b35b-4cd6-bf01-a01e1666665c'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:38.432967 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-c354ee1d-8efc-468f-878e-8130e192308b tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Delete snapshot completed successfully. Jun 18 22:36:38.441568 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-c354ee1d-8efc-468f-878e-8130e192308b tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Lock "b'cinder-22ab40b5-9325-4cf5-bad6-640c828191be-delete_snapshot'" released by "delete_snapshot" :: held 0.377s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:39.180980 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Lock "b'cinder-be6a528e-0791-4965-8d53-6ee17fee7fea-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:36:39.217918 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:39.258732 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:36:39.259454 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Volume volume-be6a528e-0791-4965-8d53-6ee17fee7fea is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:36:39.264789 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] deleting rbd volume volume-be6a528e-0791-4965-8d53-6ee17fee7fea {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:36:39.456348 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=33,cinder:SELECT=57,cinder:INSERT=7,cinder:DELETE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:39.465955 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Created reservations ['bec1dfea-4c6a-438e-8626-71e2da8c7a9e', '72f26268-5191-45ae-82e6-0c6826393631', 'd8330021-534f-42d7-abc3-b435dfe12d14', '85a5a65c-00e7-4399-96fe-5f6bfc8dcdfd'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:36:39.515087 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:39.541541 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:39.571449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:39.575642 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Deleted volume successfully. Jun 18 22:36:39.591360 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-23bd21d0-5f48-46e1-886e-99b9690b8298 tempest-VolumesSnapshotNegativeTestJSON-2067813381 None] Lock "b'cinder-be6a528e-0791-4965-8d53-6ee17fee7fea-delete_volume'" released by "delete_volume" :: held 0.410s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:36:47.369984 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:36:47.370648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:47.400033 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:36:47.426616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:36:50.867039 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=38,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:10.872096 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:30.872258 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:47.372687 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:37:47.374161 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:37:47.398311 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:37:47.424205 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:37:50.880686 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:50.883157 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:53.022262 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-16ee907f-212f-408d-8e0b-717cbf170f1a tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:37:53.304520 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-16ee907f-212f-408d-8e0b-717cbf170f1a tempest-TestVolumeBootPattern-2084543740 None] Create snapshot completed successfully Jun 18 22:37:54.460879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:37:54.488287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (6f7b0f2e-bac2-4371-ac1d-ca8324176450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:37:54.494622 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8905295-bd29-403d-8391-e194a856231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.512041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8905295-bd29-403d-8391-e194a856231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-990501748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81059721-112c-4cd1-a6b2-1e2725e20fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7a59e0743a480c9af66dea984113c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05d2d23e-4499-446e-8313-2959eb68a35c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:37:54Z,use_quota=True,user_id='406628da7a8140fd83200ffc90e71198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.517291 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9792947b-16e6-431d-b0e7-b3fd2842cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.521340 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9792947b-16e6-431d-b0e7-b3fd2842cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.526346 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379acbf5-95c9-4041-aa3f-3fc16d433b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.530299 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379acbf5-95c9-4041-aa3f-3fc16d433b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81059721-112c-4cd1-a6b2-1e2725e20fb5', 'volume_name': 'volume-81059721-112c-4cd1-a6b2-1e2725e20fb5', 'volume_size': 1, 'snapshot_id': '05d2d23e-4499-446e-8313-2959eb68a35c'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.535081 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb160b2-ac60-4331-b9fc-5330fc7d9c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.538889 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb160b2-ac60-4331-b9fc-5330fc7d9c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.543534 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc911890-4a03-4504-9b13-0a6ca756c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.544620 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Volume 81059721-112c-4cd1-a6b2-1e2725e20fb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81059721-112c-4cd1-a6b2-1e2725e20fb5', 'volume_size': 1, 'snapshot_id': '05d2d23e-4499-446e-8313-2959eb68a35c'} Jun 18 22:37:54.570019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] cloning volumes/volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04@snapshot-05d2d23e-4499-446e-8313-2959eb68a35c to volume-81059721-112c-4cd1-a6b2-1e2725e20fb5 {{(pid=123873) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 18 22:37:54.570797 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:37:54.626298 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:37:54.741954 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:37:54.742262 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:37:54.769307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Marking volume 81059721-112c-4cd1-a6b2-1e2725e20fb5 as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 22:37:54.780178 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Copying metadata from snapshot 05d2d23e-4499-446e-8313-2959eb68a35c to 81059721-112c-4cd1-a6b2-1e2725e20fb5. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 18 22:37:54.813767 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc911890-4a03-4504-9b13-0a6ca756c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81059721-112c-4cd1-a6b2-1e2725e20fb5', 'volume_size': 1, 'snapshot_id': '05d2d23e-4499-446e-8313-2959eb68a35c'}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.818207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5facbe1-c090-44d9-83fe-7c651b6009ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:37:54.827173 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Volume volume-81059721-112c-4cd1-a6b2-1e2725e20fb5 (81059721-112c-4cd1-a6b2-1e2725e20fb5): created successfully Jun 18 22:37:54.830770 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5facbe1-c090-44d9-83fe-7c651b6009ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:37:54.836417 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Flow 'volume_create_manager' (6f7b0f2e-bac2-4371-ac1d-ca8324176450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:37:54.850929 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-7d3b45c9-1ac4-411a-95b6-47f5c6827c2d tempest-TestVolumeBootPattern-2084543740 None] Created volume successfully. Jun 18 22:37:57.753767 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 req-2cdfa677-27cd-47e6-9db2-0315596d8a88 tempest-TestVolumeBootPattern-2084543740 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:37:58.523956 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 req-2cdfa677-27cd-47e6-9db2-0315596d8a88 tempest-TestVolumeBootPattern-2084543740 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.770s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:37:58.525305 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 req-2cdfa677-27cd-47e6-9db2-0315596d8a88 tempest-TestVolumeBootPattern-2084543740 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-81059721-112c-4cd1-a6b2-1e2725e20fb5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '81059721-112c-4cd1-a6b2-1e2725e20fb5', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:37:58.552357 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 req-2cdfa677-27cd-47e6-9db2-0315596d8a88 tempest-TestVolumeBootPattern-2084543740 None] Connection info returned from driver {'name': 'volumes/volume-81059721-112c-4cd1-a6b2-1e2725e20fb5', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '81059721-112c-4cd1-a6b2-1e2725e20fb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8423d84d-1d38-4858-8d0a-763880f04f56'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:37:58.602149 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 req-2cdfa677-27cd-47e6-9db2-0315596d8a88 tempest-TestVolumeBootPattern-2084543740 None] attachment_update completed successfully. Jun 18 22:38:10.885610 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=31,cinder:INSERT=13,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:30.888258 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=40,cinder:UPDATE=8,cinder:INSERT=11,cinder:DELETE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:47.370466 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:38:47.372428 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:38:47.408018 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:38:47.431157 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:38:50.886627 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:10.882293 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:20.892801 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:40.895564 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:47.367090 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:39:47.368148 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:39:47.396538 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:39:47.420501 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:39:53.513788 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:53.519876 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3a4012fe-efa5-4210-bf8e-4e532c526757 req-31605a17-a241-4ff8-baaa-c1b957c4bc7b tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:39:53.520286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-3a4012fe-efa5-4210-bf8e-4e532c526757 req-31605a17-a241-4ff8-baaa-c1b957c4bc7b tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment 8423d84d-1d38-4858-8d0a-763880f04f56. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:39:54.498241 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-81059721-112c-4cd1-a6b2-1e2725e20fb5-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:39:54.534771 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:39:54.604235 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:39:54.610229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-81059721-112c-4cd1-a6b2-1e2725e20fb5 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:39:54.845015 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['34204b85-01d4-4206-a3bd-4ab122004897', 'beda5ef8-4f33-4776-8517-dea24e7d267a', 'c5e05336-426f-424e-af73-0701ebfe2c59', 'cb642e2b-e359-4155-9bbb-52a4a6845b55'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:39:54.890143 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:39:54.917248 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:39:54.955304 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:39:54.959688 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:39:54.972330 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-4549698c-a27d-4d68-89b2-8e9c4d14874a tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-81059721-112c-4cd1-a6b2-1e2725e20fb5-delete_volume'" released by "delete_volume" :: held 0.474s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:39:55.637648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3e79de0b-a3ef-4d38-977f-dc0dca4f7882 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-05d2d23e-4499-446e-8313-2959eb68a35c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:39:55.639505 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-3e79de0b-a3ef-4d38-977f-dc0dca4f7882 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:20.899708 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:25.763005 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:25.808139 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-3e79de0b-a3ef-4d38-977f-dc0dca4f7882 tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['f0e9791f-faac-4219-81bf-e057deecfa23', '8f4e721d-4049-4d71-bee5-37263d30f978', '79cc652c-3c52-4589-8151-da1781179f08', '2dbe107a-f5bc-4a06-9819-3f01b9092d92'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:40:25.850597 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-3e79de0b-a3ef-4d38-977f-dc0dca4f7882 tempest-TestVolumeBootPattern-2084543740 None] Delete snapshot completed successfully. Jun 18 22:40:25.855637 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-3e79de0b-a3ef-4d38-977f-dc0dca4f7882 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-05d2d23e-4499-446e-8313-2959eb68a35c-delete_snapshot'" released by "delete_snapshot" :: held 30.218s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:40:30.213409 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e216042f-6d02-44ba-962a-fc1e9284a6ca req-3360f129-3806-4c55-aba1-2ad2fee796b7 tempest-TestVolumeBootPattern-2084543740 None] Terminate volume connection completed successfully. Jun 18 22:40:30.214488 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e216042f-6d02-44ba-962a-fc1e9284a6ca req-3360f129-3806-4c55-aba1-2ad2fee796b7 tempest-TestVolumeBootPattern-2084543740 None] Deleting attachment a5c07bc2-6c7c-42ce-9c27-ded2aa274fd4. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:40:32.115877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-92eb6127-5f06-4961-a0f5-c7fb19e61c04-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:40:32.148237 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:32.208616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:40:32.214395 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] deleting rbd volume volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:40:32.436732 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 22:40:32.469442 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] deleting parent snapshot volume-92eb6127-5f06-4961-a0f5-c7fb19e61c04.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 22:40:33.558878 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] Created reservations ['d7bf8108-cf6c-47b4-807a-f58180ba14d1', '23b02473-6825-47cb-b2b8-da00764e0fe8', 'ed9f617b-d91b-42fb-84d7-77e48019cbb5', 'fcc38b97-ebad-4fd4-8977-5fbd43affeea'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:40:33.602788 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:33.625979 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:33.649830 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:40:33.654408 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] Deleted volume successfully. Jun 18 22:40:33.669082 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-480e0ac5-7b73-4da8-8efc-906911230f67 tempest-TestVolumeBootPattern-2084543740 None] Lock "b'cinder-92eb6127-5f06-4961-a0f5-c7fb19e61c04-delete_volume'" released by "delete_volume" :: held 1.553s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:40:47.366198 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:40:47.367207 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:47.395794 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:40:47.421877 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:40:50.912199 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:00.908031 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:30.901352 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:40.898172 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:47.367912 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:41:47.368925 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:41:47.401309 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:41:47.425231 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:42:00.905899 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:20.901250 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:40.916262 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:47.370960 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:42:47.371973 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:42:47.402236 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:42:47.426971 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:43:00.920177 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:20.920661 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:40.929437 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:47.372504 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:43:47.373210 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:43:47.399583 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:43:47.422940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:44:00.937094 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:00.937825 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:20.942701 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:30.953955 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:47.377949 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:44:47.378739 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:44:47.403888 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:44:47.431806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:45:00.939171 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:10.936508 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:30.947895 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:30.955648 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:47.377058 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:45:47.377771 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:45:47.402699 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:45:47.426229 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:46:10.946874 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:10.947898 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:47.380985 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:46:47.382503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:46:47.407615 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:46:47.430827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:46:50.948416 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:50.949107 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:10.950172 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:20.961620 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:40.962794 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:40.964509 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:47.385939 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:47:47.386665 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:47:47.416205 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:47:47.441772 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:48:10.986457 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:10.990704 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:30.974580 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:47.389696 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:48:47.390406 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:48:47.418788 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:48:47.443935 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:48:50.978198 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:10.977748 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:30.986868 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:30.988120 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:47.389949 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:49:47.390671 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:49:47.416856 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:49:47.441503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:49:50.989607 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:00.996631 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:20.990460 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:40.998879 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:47.387113 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:50:47.388389 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:50:47.419752 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:50:47.444287 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:51:01.003517 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:21.011155 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:21.019250 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:41.018233 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:47.390375 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:51:47.391545 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:51:47.421438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:51:47.444920 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:51:51.035425 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:11.038646 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:31.034585 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:47.390166 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:52:47.391303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:52:47.423757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:52:47.452372 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:52:51.044553 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:01.047127 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:11.605842 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:53:11.625503 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Flow 'volume_create_manager' (91035691-5778-4b6c-aa37-41b6770359f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:53:11.631900 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a3fafe-500e-4915-9cc2-74a17a627afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.649404 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a3fafe-500e-4915-9cc2-74a17a627afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-963535987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d2db69f0-64b6-4b7a-8899-04a96dc2e132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50bcdb7ce3f4fd59d056bf30bda1676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:53:12Z,use_quota=True,user_id='d589e9b3b6114231927b43bb4269e7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.654531 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7353fe91-ca5f-488e-a272-757119fcdbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.658557 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7353fe91-ca5f-488e-a272-757119fcdbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.663563 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064d727-9ff9-4c85-acc3-0fae49787ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.667505 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064d727-9ff9-4c85-acc3-0fae49787ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'volume_name': 'volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.672226 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e02721c-63af-4c50-a76a-52737f96e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.676047 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e02721c-63af-4c50-a76a-52737f96e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.680569 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad0a1df-dd17-4502-a4f7-7b388e4bc2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.681659 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Volume d2db69f0-64b6-4b7a-8899-04a96dc2e132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'volume_size': 1} Jun 18 22:53:11.682053 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] creating volume 'volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:53:11.682828 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:53:11.741307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:53:11.741680 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:53:11.745379 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad0a1df-dd17-4502-a4f7-7b388e4bc2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.749844 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db05c8cc-ba78-414f-a925-69f0e9f92d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:53:11.761463 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Volume volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132 (d2db69f0-64b6-4b7a-8899-04a96dc2e132): created successfully Jun 18 22:53:11.765056 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db05c8cc-ba78-414f-a925-69f0e9f92d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:53:11.770476 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Flow 'volume_create_manager' (91035691-5778-4b6c-aa37-41b6770359f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:53:11.780164 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-77fb55a8-0ae1-40b2-a871-615af1e49a55 tempest-ServerActionsTestJSON-1349922889 None] Created volume successfully. Jun 18 22:53:13.274691 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-30be7d9a-4743-492c-bb19-812c3d730d7a req-d7229440-9322-4118-9b44-2529994e78f5 tempest-ServerActionsTestJSON-1349922889 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:53:14.021899 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-30be7d9a-4743-492c-bb19-812c3d730d7a req-d7229440-9322-4118-9b44-2529994e78f5 tempest-ServerActionsTestJSON-1349922889 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.747s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:53:14.022773 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-30be7d9a-4743-492c-bb19-812c3d730d7a req-d7229440-9322-4118-9b44-2529994e78f5 tempest-ServerActionsTestJSON-1349922889 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:53:14.049780 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-30be7d9a-4743-492c-bb19-812c3d730d7a req-d7229440-9322-4118-9b44-2529994e78f5 tempest-ServerActionsTestJSON-1349922889 None] Connection info returned from driver {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '46ba83ad-e42b-490b-a27f-b147a17d8d2a'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:53:14.099785 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-30be7d9a-4743-492c-bb19-812c3d730d7a req-d7229440-9322-4118-9b44-2529994e78f5 tempest-ServerActionsTestJSON-1349922889 None] attachment_update completed successfully. Jun 18 22:53:21.053242 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:40.871435 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:40.882146 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-6501f52b-565e-4654-9086-e46cf39d0651 tempest-ServerActionsTestJSON-1349922889 None] Terminate volume connection completed successfully. Jun 18 22:53:40.882628 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-6501f52b-565e-4654-9086-e46cf39d0651 tempest-ServerActionsTestJSON-1349922889 None] Deleting attachment 46ba83ad-e42b-490b-a27f-b147a17d8d2a. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:53:42.718980 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-cb9dfe0c-797a-4080-98e9-37cbdf3316ed tempest-ServerActionsTestJSON-1349922889 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:53:43.471126 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-cb9dfe0c-797a-4080-98e9-37cbdf3316ed tempest-ServerActionsTestJSON-1349922889 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:53:43.471942 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-cb9dfe0c-797a-4080-98e9-37cbdf3316ed tempest-ServerActionsTestJSON-1349922889 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:53:43.499307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-cb9dfe0c-797a-4080-98e9-37cbdf3316ed tempest-ServerActionsTestJSON-1349922889 None] Connection info returned from driver {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '656aef6c-b3c1-4514-8cb9-06f528f689b1'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:53:43.550146 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-c7a0a383-fb97-4b88-b88e-0f2690de0769 req-cb9dfe0c-797a-4080-98e9-37cbdf3316ed tempest-ServerActionsTestJSON-1349922889 None] attachment_update completed successfully. Jun 18 22:53:47.389756 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:53:47.391562 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:53:47.427032 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:53:47.450640 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:53:51.775307 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:51.788468 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-7c375d3a-3da3-47a2-99d5-30f4ddd001e3 tempest-ServerActionsTestJSON-1349922889 None] Terminate volume connection completed successfully. Jun 18 22:53:51.788967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-7c375d3a-3da3-47a2-99d5-30f4ddd001e3 tempest-ServerActionsTestJSON-1349922889 None] Deleting attachment 656aef6c-b3c1-4514-8cb9-06f528f689b1. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:53:54.460772 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-401448ea-b4d3-46b5-a191-af09ad30583b tempest-ServerActionsTestJSON-1349922889 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:53:55.232136 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-401448ea-b4d3-46b5-a191-af09ad30583b tempest-ServerActionsTestJSON-1349922889 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:53:55.232913 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-401448ea-b4d3-46b5-a191-af09ad30583b tempest-ServerActionsTestJSON-1349922889 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:53:55.262908 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-401448ea-b4d3-46b5-a191-af09ad30583b tempest-ServerActionsTestJSON-1349922889 None] Connection info returned from driver {'name': 'volumes/volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd2db69f0-64b6-4b7a-8899-04a96dc2e132', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e2ad73a-fd18-4d56-9a6a-ac8cac71c53a'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:53:55.328333 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf req-401448ea-b4d3-46b5-a191-af09ad30583b tempest-ServerActionsTestJSON-1349922889 None] attachment_update completed successfully. Jun 18 22:54:01.995527 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-379fc5ec-0022-4bd2-829f-9acd1de6761c req-ec137031-2d1c-43f8-b457-ccd9ec56897b tempest-ServerActionsTestJSON-1349922889 None] Terminate volume connection completed successfully. Jun 18 22:54:01.996124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-379fc5ec-0022-4bd2-829f-9acd1de6761c req-ec137031-2d1c-43f8-b457-ccd9ec56897b tempest-ServerActionsTestJSON-1349922889 None] Deleting attachment 7e2ad73a-fd18-4d56-9a6a-ac8cac71c53a. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:54:03.112292 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Lock "b'cinder-d2db69f0-64b6-4b7a-8899-04a96dc2e132-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:54:03.146395 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:54:03.185448 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:54:03.185895 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Volume volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:54:03.190119 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] deleting rbd volume volume-d2db69f0-64b6-4b7a-8899-04a96dc2e132 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:54:03.377290 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Created reservations ['d67af0fd-6ac8-4ab1-9957-574d813bdbb9', '07acc7aa-92ea-4387-8a1c-fed3ed6c0828', '1b2f7aa5-198c-40eb-9dd3-e0eb27762c99', 'f62756e1-adeb-413b-8afa-53866692e751'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:54:03.431969 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:54:03.455577 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:54:03.480135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:54:03.484499 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Deleted volume successfully. Jun 18 22:54:03.498523 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-fccbf753-e251-42ce-80ae-31545f3a9a7b tempest-ServerActionsTestJSON-1349922889 None] Lock "b'cinder-d2db69f0-64b6-4b7a-8899-04a96dc2e132-delete_volume'" released by "delete_volume" :: held 0.386s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:54:11.064240 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=48,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:31.067098 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=31,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:31.070385 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:47.385467 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:54:47.386169 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:54:47.415294 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:54:47.441301 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:55:01.066808 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:11.076260 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:11.077133 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:43.485254 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:43.487168 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:43.504075 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 22:55:43.523820 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Flow 'volume_create_manager' (84aa8762-fb7c-4cbb-8ff2-fa255fd68656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:55:43.530250 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd90837-6197-44f4-b956-24035b240fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.545881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd90837-6197-44f4-b956-24035b240fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T22:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1458706347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26b856df-e6aa-433f-b188-fe21b8474789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f576ae59a362455993f77dfdb870e37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T22:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T22:55:43Z,use_quota=True,user_id='c544eb954e434fbda5d92667d6f4a2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.551024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8531bfbd-27b7-43c3-8154-896f0eef5c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.555124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8531bfbd-27b7-43c3-8154-896f0eef5c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.560040 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c17506-9260-4346-bef3-8b89dcece2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.564024 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c17506-9260-4346-bef3-8b89dcece2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b856df-e6aa-433f-b188-fe21b8474789', 'volume_name': 'volume-26b856df-e6aa-433f-b188-fe21b8474789', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.568715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97ef407-caea-4234-877d-1542a9319602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.572547 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97ef407-caea-4234-877d-1542a9319602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.577247 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5068d0e6-f63e-4c79-9208-0f06d5e9a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.578297 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Volume 26b856df-e6aa-433f-b188-fe21b8474789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b856df-e6aa-433f-b188-fe21b8474789', 'volume_size': 1} Jun 18 22:55:43.578715 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] creating volume 'volume-26b856df-e6aa-433f-b188-fe21b8474789' {{(pid=123873) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 18 22:55:43.579451 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:55:43.648353 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 22:55:43.648821 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 22:55:43.652531 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5068d0e6-f63e-4c79-9208-0f06d5e9a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b856df-e6aa-433f-b188-fe21b8474789', 'volume_size': 1}' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.656985 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa446f1-6b70-4c49-b690-25fdab2b3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 22:55:43.669315 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Volume volume-26b856df-e6aa-433f-b188-fe21b8474789 (26b856df-e6aa-433f-b188-fe21b8474789): created successfully Jun 18 22:55:43.672852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa446f1-6b70-4c49-b690-25fdab2b3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 22:55:43.678356 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Flow 'volume_create_manager' (84aa8762-fb7c-4cbb-8ff2-fa255fd68656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 22:55:43.688088 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-26e5777b-ddc1-417e-8bfc-3ccf360df6fa tempest-TestMinimumBasicScenario-154202770 None] Created volume successfully. Jun 18 22:55:45.184300 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 req-f3d21351-d3fa-4809-bc71-d76404b28fe6 tempest-TestMinimumBasicScenario-154202770 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:55:45.948623 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 req-f3d21351-d3fa-4809-bc71-d76404b28fe6 tempest-TestMinimumBasicScenario-154202770 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.763s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:55:45.949602 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 req-f3d21351-d3fa-4809-bc71-d76404b28fe6 tempest-TestMinimumBasicScenario-154202770 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26b856df-e6aa-433f-b188-fe21b8474789', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': '26b856df-e6aa-433f-b188-fe21b8474789', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 22:55:45.985268 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 req-f3d21351-d3fa-4809-bc71-d76404b28fe6 tempest-TestMinimumBasicScenario-154202770 None] Connection info returned from driver {'name': 'volumes/volume-26b856df-e6aa-433f-b188-fe21b8474789', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26b856df-e6aa-433f-b188-fe21b8474789', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4954695a-2b37-4f36-9ece-d21fe2778be3'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 22:55:46.037487 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 req-f3d21351-d3fa-4809-bc71-d76404b28fe6 tempest-TestMinimumBasicScenario-154202770 None] attachment_update completed successfully. Jun 18 22:55:47.386565 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:55:47.387653 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:55:47.428588 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:55:47.462438 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:56:21.060093 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=21,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:21.061766 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:47.388782 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:56:47.389991 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:56:47.422511 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:56:47.446421 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:56:51.061961 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:01.060096 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:10.058325 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-f95a806c-219a-4c08-b6db-1f68a3145f00 req-5adda12e-2e0e-434c-9f68-3f234528457a tempest-TestMinimumBasicScenario-154202770 None] Terminate volume connection completed successfully. Jun 18 22:57:10.058976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-f95a806c-219a-4c08-b6db-1f68a3145f00 req-5adda12e-2e0e-434c-9f68-3f234528457a tempest-TestMinimumBasicScenario-154202770 None] Deleting attachment 4954695a-2b37-4f36-9ece-d21fe2778be3. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 22:57:10.641178 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Lock "b'cinder-26b856df-e6aa-433f-b188-fe21b8474789-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 22:57:10.672779 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:57:10.712233 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 22:57:10.712674 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Volume volume-26b856df-e6aa-433f-b188-fe21b8474789 is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 22:57:10.717563 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] deleting rbd volume volume-26b856df-e6aa-433f-b188-fe21b8474789 {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 22:57:10.917809 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Created reservations ['47ce969c-9d77-4319-a927-9e457312399c', 'eba971bb-a95e-4862-9a31-2dc6e81f935a', '0c690ca4-8fcb-471a-aeb5-26df512e0e47', 'fe078344-54fd-422a-b13c-670bc683c269'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 22:57:10.963449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:57:10.987159 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:57:11.010945 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:57:11.015211 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Deleted volume successfully. Jun 18 22:57:11.035573 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-5c4959aa-baae-406b-acfb-8cdf53eb6975 tempest-TestMinimumBasicScenario-154202770 None] Lock "b'cinder-26b856df-e6aa-433f-b188-fe21b8474789-delete_volume'" released by "delete_volume" :: held 0.394s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 22:57:21.057383 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:41.060397 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=20,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:47.392358 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:57:47.393751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:57:47.428959 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:57:47.453532 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:58:01.062494 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:21.063087 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:41.065976 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:47.388933 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:58:47.390037 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:58:47.426042 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:58:47.449765 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 22:59:01.063322 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:21.059263 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:41.053893 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:47.384544 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 22:59:47.385188 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:59:47.407915 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 22:59:47.432136 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:00:01.050583 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:21.049855 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:41.050510 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:47.387253 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:00:47.388617 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:00:47.419449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:00:47.457524 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:01:01.052322 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:21.056125 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:31.067236 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:47.383883 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:01:47.385003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:01:47.415930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:01:47.439179 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:01:51.059750 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:01.070093 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:31.062081 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:41.067001 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:11.069494 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:21.075549 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:41.073077 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:47.386474 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:03:47.387592 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:03:47.414470 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:03:47.438121 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:03:51.073128 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:21.072502 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:31.069796 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:41.078820 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:47.382778 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:04:47.383458 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:04:47.421609 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:04:47.457930 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:05:01.080216 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:01.084867 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:21.083194 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:41.084326 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:47.384131 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:05:47.384756 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:05:47.415997 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:05:47.448003 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:06:01.090824 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:21.079660 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:41.080937 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:47.384090 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:06:47.385234 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:06:47.415042 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:06:47.439043 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:07:01.082423 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:07:21.080176 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:07:31.082873 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:07:47.385021 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:07:47.386101 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:07:47.414456 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:07:47.438021 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:08:01.082960 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:11.087121 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:31.086579 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:41.073821 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:47.383298 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:08:47.383990 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:08:47.413522 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:08:47.436784 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:09:01.077243 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:09:21.079732 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:09:41.082547 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:09:47.382588 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:09:47.383464 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:09:47.410808 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:09:47.434639 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:10:01.080736 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:21.083271 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:41.089279 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:47.380145 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:10:47.380834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:10:47.407297 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:10:47.434395 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:10:51.096223 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:51.188041 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=123873) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 18 23:10:51.211122 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Flow 'volume_create_manager' (004d2f7a-30ed-4f4e-9b1e-e074e8ceb974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 23:10:51.218333 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934497d8-4709-4718-9c23-824e4de4414c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:51.235544 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934497d8-4709-4718-9c23-824e4de4414c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-18T23:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-697101016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0c09c67-8c18-4506-8650-73e45a9d5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0a1057e25d41ca9225c5e5072f17a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-18T23:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-18T23:10:51Z,use_quota=True,user_id='62490dbd2f174221b6dda00ce8c3e916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f09357f8-d9b5-4c4e-a3ec-43ae84e236bc),volume_type_id=f09357f8-d9b5-4c4e-a3ec-43ae84e236bc)' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:51.240755 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00a2aca-8a15-49a6-80f5-b219e06e5bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:51.244786 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00a2aca-8a15-49a6-80f5-b219e06e5bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:51.249685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9942d377-4109-4a40-b55b-6b50f7acdd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:51.335163 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9942d377-4109-4a40-b55b-6b50f7acdd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'volume_name': 'volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:51.340307 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf820032-900c-42a2-aecd-633ad1784063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:51.344113 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf820032-900c-42a2-aecd-633ad1784063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:51.348658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f2dc44-78a9-49d1-9cf1-2d178891e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:51.349791 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Volume e0c09c67-8c18-4506-8650-73e45a9d5b0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 18 23:10:51.350355 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Cloning e0c09c67-8c18-4506-8650-73e45a9d5b0d from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad at location (None, None). {{(pid=123873) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 18 23:10:51.384317 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" acquired by "_prepare_image_cache_entry" :: waited 0.033s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 23:10:51.396436 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 23, 10, 51, 389013)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 23:10:51.396861 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 23:10:51.397286 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Found cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 18 23:10:51.401406 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Lock "b'cinder-5a3e12b2-cae5-4235-b8ef-6052c81f2dad'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 23:10:51.402343 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Attempting to retrieve cache entry for image = 5a3e12b2-cae5-4235-b8ef-6052c81f2dad on host ncdv-master-1@ceph#ceph. {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 18 23:10:51.408008 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Found image-volume cache entry: {'id': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'volume_id': '0526064b-f11a-4258-bed1-9a39e5a985f6', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9), 'last_used': datetime.datetime(2022, 6, 18, 23, 10, 51, 405797)}. {{(pid=123873) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 18 23:10:51.408420 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.image.cache [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Image-volume cache entry image_update_at = 2022-06-18 21:52:09+00:00, requested image updated_at = 2022-06-18 21:52:09+00:00. {{(pid=123873) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 18 23:10:51.408806 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Creating from source image-volume 0526064b-f11a-4258-bed1-9a39e5a985f6 {{(pid=123873) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 18 23:10:51.420770 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:10:51.469449 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] creating snapshot='volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d.clone_snap' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 18 23:10:52.004978 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] cloning 'volume-0526064b-f11a-4258-bed1-9a39e5a985f6@volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d.clone_snap' to 'volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d' {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 18 23:10:52.130751 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Volume volume-aa66e756-7e7b-41ce-aa13-407ac178ec3c.deleted is not a clone. {{(pid=123873) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 18 23:10:52.131944 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 18 23:10:52.132318 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=123873) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 18 23:10:52.146220 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] clone created successfully {{(pid=123873) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 18 23:10:52.146852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.volume_utils [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Marking volume e0c09c67-8c18-4506-8650-73e45a9d5b0d as bootable. {{(pid=123873) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 18 23:10:52.155600 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Copying metadata from image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad to e0c09c67-8c18-4506-8650-73e45a9d5b0d. {{(pid=123873) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 18 23:10:52.156161 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Creating volume glance metadata for volume e0c09c67-8c18-4506-8650-73e45a9d5b0d backed by image 5a3e12b2-cae5-4235-b8ef-6052c81f2dad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=123873) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 18 23:10:52.209903 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f2dc44-78a9-49d1-9cf1-2d178891e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'volume_size': 1, 'image_id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66f428458e264ccfa7aaee63beb4b0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'created_at': datetime.datetime(2022, 6, 18, 21, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 18, 21, 52, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:52.214827 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7744764f-42ce-43fd-9553-112e75d8f5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 18 23:10:52.224634 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.flows.manager.create_volume [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Volume volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d (e0c09c67-8c18-4506-8650-73e45a9d5b0d): created successfully Jun 18 23:10:52.228348 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7744764f-42ce-43fd-9553-112e75d8f5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123873) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 18 23:10:52.233940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Flow 'volume_create_manager' (004d2f7a-30ed-4f4e-9b1e-e074e8ceb974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123873) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 18 23:10:52.242965 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [None req-bb1017d7-5e46-4c95-ab61-d6bab3995c63 tempest-TestShelveInstance-658414119 None] Created volume successfully. Jun 18 23:10:59.346596 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-09f07ffd-64a6-464c-a649-3c777e1aedad req-b31f1569-fcbe-4de2-b683-0411f1f15ce0 tempest-TestShelveInstance-658414119 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 23:11:00.118351 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-09f07ffd-64a6-464c-a649-3c777e1aedad req-b31f1569-fcbe-4de2-b683-0411f1f15ce0 tempest-TestShelveInstance-658414119 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 23:11:00.119099 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-09f07ffd-64a6-464c-a649-3c777e1aedad req-b31f1569-fcbe-4de2-b683-0411f1f15ce0 tempest-TestShelveInstance-658414119 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 23:11:00.145822 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-09f07ffd-64a6-464c-a649-3c777e1aedad req-b31f1569-fcbe-4de2-b683-0411f1f15ce0 tempest-TestShelveInstance-658414119 None] Connection info returned from driver {'name': 'volumes/volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44c3386a-5653-4678-ab21-5f501cb0b8f9'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 23:11:00.199504 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-09f07ffd-64a6-464c-a649-3c777e1aedad req-b31f1569-fcbe-4de2-b683-0411f1f15ce0 tempest-TestShelveInstance-658414119 None] attachment_update completed successfully. Jun 18 23:11:11.094402 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=30,cinder:UPDATE=4,cinder:INSERT=8,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:11.095064 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:47.379750 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:11:47.380611 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:11:47.406934 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:11:47.434939 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:11:51.098529 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:51.101214 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:12:31.110451 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:12:31.111314 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:12:47.381315 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:12:47.382358 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:12:47.415532 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:12:47.440594 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:12:51.113800 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:01.121757 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:21.121886 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:29.868109 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-e54bf7b8-04e3-4514-b5e0-203f27a2510a req-d2945a78-9228-4cd3-907e-15f30677c76b tempest-TestShelveInstance-658414119 None] Terminate volume connection completed successfully. Jun 18 23:13:29.868767 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-e54bf7b8-04e3-4514-b5e0-203f27a2510a req-d2945a78-9228-4cd3-907e-15f30677c76b tempest-TestShelveInstance-658414119 None] Deleting attachment 44c3386a-5653-4678-ab21-5f501cb0b8f9. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 23:13:31.131119 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:31.751632 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-765284e2-a531-49cf-b07d-4f49f681dd4a req-ddd97552-0df6-4eac-96a2-e73cfc6bed75 tempest-TestShelveInstance-658414119 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 23:13:32.500434 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_concurrency.processutils [req-765284e2-a531-49cf-b07d-4f49f681dd4a req-ddd97552-0df6-4eac-96a2-e73cfc6bed75 tempest-TestShelveInstance-658414119 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=123873) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 23:13:32.501484 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-765284e2-a531-49cf-b07d-4f49f681dd4a req-ddd97552-0df6-4eac-96a2-e73cfc6bed75 tempest-TestShelveInstance-658414119 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '9f4b4bf4-6af2-4e15-9589-dd111594dd39', 'volume_id': 'e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'discard': True}} {{(pid=123873) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 18 23:13:32.528867 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-765284e2-a531-49cf-b07d-4f49f681dd4a req-ddd97552-0df6-4eac-96a2-e73cfc6bed75 tempest-TestShelveInstance-658414119 None] Connection info returned from driver {'name': 'volumes/volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'hosts': ['10.222.0.30'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e0c09c67-8c18-4506-8650-73e45a9d5b0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6a66acb8-7c24-41a7-966c-ca939a2bed21'} {{(pid=123873) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 18 23:13:32.578146 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-765284e2-a531-49cf-b07d-4f49f681dd4a req-ddd97552-0df6-4eac-96a2-e73cfc6bed75 tempest-TestShelveInstance-658414119 None] attachment_update completed successfully. Jun 18 23:13:47.386300 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:13:47.387117 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:13:47.414430 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:13:47.441554 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:14:01.119399 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=16,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:14:01.123682 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:14:21.127903 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:14:41.126576 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:14:47.388458 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:14:47.389658 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:14:47.416254 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:14:47.439555 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:15:01.132062 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:04.140120 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-c4432512-e497-42e9-b237-0ad95e74fdc6 tempest-TestShelveInstance-658414119 None] Terminate volume connection completed successfully. Jun 18 23:15:04.140757 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.manager [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-c4432512-e497-42e9-b237-0ad95e74fdc6 tempest-TestShelveInstance-658414119 None] Deleting attachment 6a66acb8-7c24-41a7-966c-ca939a2bed21. {{(pid=123873) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 18 23:15:04.278122 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] Lock "b'cinder-e0c09c67-8c18-4506-8650-73e45a9d5b0d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 18 23:15:04.324303 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:15:04.397940 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] volume has no backup snaps {{(pid=123873) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 18 23:15:04.404879 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] deleting rbd volume volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 18 23:15:04.622616 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] volume is a clone so cleaning references {{(pid=123873) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 18 23:15:04.652051 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] deleting parent snapshot volume-e0c09c67-8c18-4506-8650-73e45a9d5b0d.clone_snap {{(pid=123873) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 18 23:15:05.351158 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.quota [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] Created reservations ['179845f7-6d68-445d-90b8-359c9e8312b3', '86d1ceeb-bb83-47c3-b1b1-ef1d848b75ad', '6ccacec6-6bd7-4b67-8ae1-3d08eead5503', 'bd639a85-8619-4fa8-be08-982fa91c3cb9'] {{(pid=123873) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 18 23:15:05.394976 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:15:05.417600 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:15:05.441313 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:15:05.445785 ncdv-master-1 cinder-volume[123873]: INFO cinder.volume.manager [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] Deleted volume successfully. Jun 18 23:15:05.460096 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.coordination [req-bbf8b7cc-bcef-4571-986a-b3ba075412ba req-759a91fa-0e88-4750-9e1e-26f37923180b tempest-TestShelveInstance-658414119 None] Lock "b'cinder-e0c09c67-8c18-4506-8650-73e45a9d5b0d-delete_volume'" released by "delete_volume" :: held 1.182s {{(pid=123873) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 18 23:15:21.134713 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:21.139086 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:41.148648 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:47.384966 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:15:47.385798 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:15:47.412748 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:15:47.436305 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:16:01.147657 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:16:01.148762 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:16:21.150291 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:16:31.155822 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:16:47.381816 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:16:47.382586 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:16:47.407575 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:16:47.430668 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:16:51.165098 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:11.159167 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:11.165151 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:47.386293 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:17:47.387881 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:17:47.421000 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:17:47.453610 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:17:51.164527 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:51.166083 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:21.183927 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:21.186225 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:47.389662 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:18:47.390847 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:18:47.419570 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:18:47.442753 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:19:01.185461 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:19:01.188701 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:19:21.187574 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:19:41.192788 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:19:47.388653 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:19:47.389870 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:19:47.424847 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:19:47.447743 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:19:51.205627 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:11.203098 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:31.216113 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:47.393296 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:20:47.395411 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:20:47.511135 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:20:47.543138 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:20:51.207581 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:21:11.209376 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:21:21.222081 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:21:47.398909 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:21:47.399852 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:21:47.431414 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:21:47.454124 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:21:51.213839 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:22:01.219274 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:22:21.230616 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:22:41.223332 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1,cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:22:47.400738 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:22:47.401924 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:22:47.432648 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:22:47.455433 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:23:01.233076 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:23:01.235552 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:23:31.238467 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:23:31.249607 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:23:47.401147 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:23:47.402170 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:23:47.428836 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:23:47.454551 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:24:01.243409 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:24:01.259789 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:24:31.252800 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1,cinder:SELECT=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:24:41.252331 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:24:47.400985 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:24:47.401799 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:24:47.426967 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:24:47.449720 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:25:01.265355 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:25:11.275597 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:25:31.277567 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:25:47.406165 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:25:47.407274 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:25:47.435758 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:25:47.459019 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:25:51.273004 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:26:11.280878 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:26:11.282022 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:26:41.291983 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:26:47.405116 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:26:47.406482 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:26:47.430036 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:26:47.455580 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:26:51.285395 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:27:21.286777 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:27:31.282100 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:27:47.401841 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:27:47.402887 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:27:47.437052 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:27:47.462071 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:27:51.293588 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:01.289719 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:11.304814 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:31.306432 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:31.312313 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:41.316902 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:47.397742 ncdv-master-1 cinder-volume[123873]: DEBUG oslo_service.periodic_task [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=123873) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 18 23:28:47.398834 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:28:47.433626 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.volume.drivers.rbd [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=123873) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 18 23:28:47.456685 ncdv-master-1 cinder-volume[123873]: DEBUG cinder.manager [None req-62f0685a-6ca1-47d3-9cac-fde3d55d3b67 None None] Notifying Schedulers of capabilities ... {{(pid=123873) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 18 23:28:51.320231 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:29:11.330757 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:29:21.334612 ncdv-master-1 cinder-volume[123873]: DEBUG dbcounter [-] [123873] Writing DB stats cinder:SELECT=6 {{(pid=123873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}